Category: Python
-
Pandas data frame preview: df.head and df.sample
Want to get a quick look at a Python Pandas data frame you just created? Option 1, use df.head(n) to look at the first n rows: Option 2, use df.sample(n) to look at n randomly selected rows:
-
Free real-world Pandas exercises, with solutions
If you want to get better at Pandas, the hard part isn’t finding tutorials. It’s finding problems worth solving. Most exercises hand you a tidy little table of five rows and ask you to sum a column — which teaches you the syntax, but nothing about the job. For the last 3.5 years, I’ve written…
-
Pandas read_csv reads zipped CSV files without unzipping
Want to read a zipped CSV file into a Python Pandas data frame: Just pass the filename to read_csv: The file can contain a single CSV file, with an extension of .gz, .bz2, .zip, .xz, .zst, .tar, .tar.gz, .tar.xz, or .tar.bz2.
-
Excel sheet names in Pandas: Listing them with pd.ExcelFile
What sheets are in an Excel document you’re about to read into Python Pandas? You can check with: You’ll get a list of Python strings back.
-
Pandas isin vs | for filtering: which is faster
Which is faster in Python Pandas, | or isin? I prefer isin; it’s clearer to write and read. Plus, fewer worries about parentheses. But is it faster? Depends on the dtype! isin edges out | on strings, but | wins on ints. Bottom line: Use %%timeit to check. Don’t just guess!
-
Pandas isin: Filtering rows that match multiple values
Want rows in a Python Pandas data frame that might have several values? Another way (besides the | I showed yesterday) is the “isin” method: We’ll compare isin vs. | speed tomorrow. But I find this far more readable.
-
Pandas OR conditions: Filtering rows with | and parentheses
Want rows in a Python Pandas data frame that might have several values? You can use the | operator, but be sure to use () to avoid precedence issues:
-
Pandas loc filter order: Put the most selective filter first
Stacking loc to filter a Python Pandas dataframe? Order can matter:
-
Filtering rows in Pandas with .loc and pd.col
Filtering rows in a Python Pandas data frame? Use .loc: pd.col refers to the previous line’s returned data frame. So we can stack them:
-
Python list memory: Why sys.getsizeof ignores the elements
How much memory does a Python list use? sys.getsizeof will tell you, sort of: It reports the memory used by the list, but not its elements: