🐍 Python - Packages
This note contains some worthy Python packages that I should try out or as a reminder when I need them again.
pytest: Testing framework for Python.
freezegun: Allow controlling time for tests by mocking the
Requests: Doing HTTP requests much better than
Celery: Use Celery for asynchronous and automated tasks. All calls that don't need to be done this instant should be stuffed to a Celery queue e.g. sending email.
Celery tasks can also be timed so no need for scheduling cron jobs.
Use a fast memory based database for Celery backend e.g. Redis.
click: Define help messages and interface for your command-line interface.
pyquery (with lxml): Parsing HTML in jQuery like syntax, fast.
lxml: More robust handling of XML and HTML.
fuzzywuzzy: Comparing fuzzy strings.
Structlog: Handling your logging and making them more readable.
Scrapy: Web data mining/scraping package.
Flask: A simple web framework.
If you are doing heavy array and matrix operations, use NumPy / SciPy / Pandas.