Category: Python
-
Pandas dropna: The best way to remove NaN values from a series
Coming to Python Pandas from NumPy? You’ll reach for np.isnan: Unfortunately, this works. Better, use s.isna (or s.isnull). But the best way to drop NaN? Use dropna:
-
New on the LernerPython practice system: A visual debugger
I’m a big fan of exercises, which is why the LernerPython platform includes hundreds of them — all using my in-browser practice system, which handles Python, Pandas, and Git, along with an AI-based Socratic tutor based on my writing. As of today, the practice system is even better: It includes a visual debugger, allowing you…
-
PyArrow dtypes in pandas: Nullable integers with pd.NA
PyArrow dtypes in Python Pandas are nullable (with pd.NA): s is: 0 101 <NA>2 30dtype: int64[pyarrow] The dtype is int64, but allows nulls. (Use np.nan? It’s turned into pd.NA.)
-
Pandas nullable integers: Keeping ints with Int64 and pd.NA
You have a Python Pandas series with ints + NaN. You don’t want float forced on you. Solution: Use the “extension” type Int64 (note Initial Caps) and pd.NA: s is: 0 101 <NA>2 30dtype: Int64
-
Get Python help, one on one: my coaching sessions
Some of the most satisfying work I do happens one on one. You arrive with a real problem from your real job — code that will not behave, an architecture you are unsure about, a Git situation that has you stuck — and an hour later it is smaller, or gone. I have offered these…
-
NaN in Pandas: Why you need np.nan, not pd.NaN
Missing data? NumPy calls it nan. Python Pandas displays it as NaN. But: Pandas doesn’t define pd.nan or pd.NaN. NumPy removed np.NaN in version 2.0. So you have to refer to np.nan from within Pandas, and it’ll be displayed as NaN.
-
np.nan in Pandas: Why missing values break comparisons
Missing data in Python Pandas? We use nan (“not a number”), which comes from NumPy. np.nan is a float, but not a normal one:
-
Python callables: Any object that defines __call__
What is a “callable” in Python? Typically, a function or class. But really, it’s anything with __call__ defined: The “callable” builtin basically returns True if it finds __call__.
-
Python += calls __add__ and rebinds to a new object
If you invoke +=, Python can use __add__. MyClass implements __add__ (calling print for debugging): m1 now refers to a new object, and its repr is: MyClass instance, vars(self)={‘x’: 30}
-
Python in operator: How __contains__ speeds up membership tests
How does the “in” operator work in Python? – If an object defines __contains__, then its (boolean) result is returned (coerced to bool).– If not, then Python iterates over it with __iter__ Can you find and return a result faster than __iter__? Then define __contains__.