pythonpandasdataframedimension
why sample's size is difference when concatenate two dataframe?
I transformed separately training set and test set to get dummies for categorical features with pandas.get_dummies().
So the dimension difference occurred because of categorical differences in the training set and the test set.
I tried to equalize the dimension.
But the problem below occurred.
Why is the sample size different when concatenating two dataframes?
Solution
In my opinion there is not default RangeIndex in X_train.index, so need create it before concat:
X_train = X_train.reset_index(drop=True)
Another solution is add parameter index for same indices in both DataFrames:
diff_df2 = pd.Dataframe(np.zeros((X_train.shape[0], len(diff_dummy2))),
columns=diff_dummy2,
index= X_train.index)
- Python method chaining in functional programming style
- flask-jwt-extended: Fake Authorization Header during testing (pytest)
- For loop through the list unless empty?
- Polars make all groups the same size
- Is there a way to specify a default base-template for all templates in django?
- How to tackle time limit exceeded error in leetcode
- Is pd.get_dummies() updated in newer versions of Pandas making it default to Booleans (True/False) instead of (0/1)?
- What's the function like sum() but for multiplication? product()?
- How to type hint a dynamically-created dataclass
- Issue with pulling the data with EIA API with Python
- 403 Forbidden Error when scraping a site, user-agents already used and updated. Any ideas?
- Fullstack web-hosting services
- How to handle an AnalysisException on Spark SQL?
- Python requests is slow and takes very long to complete HTTP or HTTPS request
- Is there a way to modify an element in a Numpy array based on the value of other elements?
- Tkinter grid manager height/width nonconsistent
- Sql Alchemy Insert Statement failing to insert, but no error
- How can I create a Polars struct while eval-ing a list?
- Excel using win32com and python
- django: on pypy, psyco, unladen swallow or cpython, which one is the fastest?
- How convert a list into multiple columns and a dataframe?
- Name not defined in type annotation
- Static type checkers and Language Servers not recognizing attributes of objects that are subclasses
- How do I get multiple OID values in PySNMP?
- how to log a file in Django
- Is there a simple and efficient way to evaluate Elementary Symmetric Polynomials in Python?
- Iterating over two lists one after another
- Python -i flag for production
- What is PyCompilerFlags in Python C API?
- How to make Python check whether a variable is a number or letter