Tag: Pandas
-
Pandas Series and DataFrame methods: same names, column-wise results
Know Python Pandas series methods? You already know data frame methods! Same methods, applied column-wise!
-
Reading multi-sheet Excel files in Pandas with sheet_name
Reading a multi-sheet Excel file into Python Pandas? Ask for a specific sheet by name or index: Get a dict of data frames with specific sheets:
-
Pandas memory usage: Why you need deep=True for text columns
How much memory does a text column in your Python Pandas data frame use? Check: But this is likely a huge underestimate! It sums the pointer sizes, not the string sizes. Instead, say: Or:
-
Pandas read_csv accepts a URL: Loading remote data files
Want to turn an online CSV file into a Python Pandas data frame? Just pass a URL to read_csv: Options such as usecols and index_col work! This works on all read_* methods, including read_excel, read_json, and read_parquet.
-
Saving a Pandas plot to a file with get_figure and savefig
After plotting a Python Pandas data frame in Jupyter, how do you save it to a file?
-
Pandas datetime index slicing: sort_index to avoid a KeyError
If your Python Pandas dataframe has a datetime index, use a slice to retrieve rows in a certain time period: But if the rows are unsorted? You get a KeyError. Solution:
-
Pandas nlargest: Finding top rows faster than sort_values
Retrieve rows of a Python Pandas data frame with the 6 largest values of column x: Even better: Why is it better? On a 3m row, 680 MB data frame, sort/tail took 622 ms. nlargest? Only 84 ms — 7x faster!
-
Pandas column arguments: Where one name works, a list does too
A Python Pandas rule of thumb: Wherever you can use a column name (string), you can use multiple column names (a list of strings):
-
Pandas sort_values: Sorting a data frame by multiple columns
To sort a Python Pandas data frame by column x: By x and y (ascending): By x and y, both descending: Ascending x, descending y:
-
Pandas select_dtypes: Selecting columns by their dtype
Need specific column types in Python Pandas? Use select_dtypes: