Team data science processes

Team Data Science Process I have talked in the past in this blog about the need for standardisation of data science and data science processes. Microsoft has made progress on that front. It has released a particular methodology called TDSP (Team Data Science Process). This is an attempt to formalise the way Read more…

Engineering can be of different types

Data Science Protocols

Standardising data science

One of the main problems in data science practice is the lack of standardisation regarding procedures and techniques. Coming out of education and moving into the industry you can find yourself with knowledge of various methods and approaches, but no clear guide on best practices. Indeed, data science still largely remains an endeavour largely based on intuition and personal experience.

In other engineering disciplines there are standards to ensure the quality of the final result. Of course, data science is different to engineering disciplines such as civil engineering or computer engineering, where the final output is a physical product. Data science is closer to software engineering, where the lack of physical components means there are smaller  construction costs, and considerably more room to experiment and try different things out.

(more…)