Notes

• ​If you can solve a problem with a simple heuristic, do that. Sometimes you don't need machine learning.​

• Data is not always useful and it doesn't matter how much of it you have.

  There’s no mathematical tool to tell you if your hypothesis is true; you can only see whether it is consistent with the data, and if the data is sparse or unclear, your conclusions are uncertain.

Links

• ​Some advice for young and aspiring Data Scientists​

• ​A Beginner’s Guide to Data Engineering — Part I​

• ​The Rise of the Data Engineer​

• ​Cookiecutter Data Science - Logical, reasonably standardized, but flexible project structure for doing and sharing data science work.

• ​Best way to organize research code? (2018)​

• ​Data Science Cheat Sheet​

• ​Our world in data​

• ​Free data science books​

• ​Pachyderm - Reproducible Data Science at Scale.

• ​Data Science Cheat Sheets​

• ​Data Science in Visual Studio Code using Neuron, a new VS Code extension (2018)​

• ​Reflow - Language and runtime for distributed, incremental data processing in the cloud.

• ​Virgilio - Mentor for Data Science E-Learning.

• ​Awesome Data Science with Python - Curated list of Python resources for data science.

• ​Data Science (Cheat Sheets)​

• ​nteract - Interactive computing suite for you.

• ​120 Data Science Interview Questions​

• ​How To Become a Data Engineer​

• ​Ingestion Data Mapping Language​

• ​The reference implementation of IDML for the JVM​

• ​Pandas - Powerful Python data analysis toolkit.

• ​Programming Language Support for Data-intensive Applications meeting (2019)​

• ​Datasette - Tool for exploring and publishing data.

• ​Weld - High-performance runtime for data analytics applications.

• ​Vaex - Out-of-Core DataFrames for Python, visualize and explore big tabular data at a billion rows per second.

• ​Maarten Breddels & Jovan Veljanoski- A new approach to DataFrames and pipelines - PyData London 2019 (GitHub)

• ​The Data Engineering Cookbook​

• ​Data science without borders - Wes McKinney (2017)​

• ​Curated list of awesome ETL frameworks, libraries, and software​

• ​Ibis - Python data analysis framework for Hadoop and SQL engines.

• ​Kyso - Data analytics knowledge hub.

• ​Feather - Fast, interoperable binary data frame storage for Python, R, and more powered by Apache Arrow.

• ​ROOT system - Provides a set of OO frameworks with all the functionality needed to handle and analyze large amounts of data in a very efficient way.