Data Science vs. Software Engineering. Data Science is a topic that you can find anywhere nowadays.
Data Science vs. Software Engineering. The work of a Software Engineer is to analyze a problem, think about a good solution, design it, implement it and then test it. Software Engineers do problem-solving. The work of the Software Engineer ends when he finishes implementing the solution for the problem.
The work of a Data Scientist is to make good predictions or classifications based on past behavior. The Data Scientist does not create solutions, he creates models that are able to generate such predictions or classifications.
Data Science vs. Software Engineering.Who is a Data Scientist?
Data Science vs. Software Engineering. It then tries to optimize these models, so that the new models will generate better predictions or classifications than the previous models. The work of the Data Scientist never ends. In particular there is always more work when behavior is changing over time.
It may take lots of time until the Data Scientist is able to generate his/her first good model. The Data Scientist needs to analyze the data, clean the data, generate new features, select the best features, train models, try different Machine Learning algorithms, try different parameters for each Machine Learning algorithm and measure diverse offline metrics. Each one of these steps may require several weeks of work or even months.
Thus, the work of the Data Scientist should not have hard deadlines. It is very difficult for a Data Scientist to provide good estimates of when he/she may have a model that is good enough to be deployed in production.
Data Science vs. Software Engineering. Implementation vs. Experimentation
Data Science vs. Software Engineering. .Software Engineering teams are mostly busy implementing new features. Data Science teams are mostly busy running experiments.
A feature has a clear functionality being provided, and in general it is a solution to a problem. By the end of the implementation, the new feature becomes part of the system. The goal of implementing features is to add functionality to the system.
An experiment is a way to check a hypothesis. Depending on the results of the experiment, we may prove that the hypothesis is true or false. If we prove that the hypothesis is false, this does not mean that the experiment has failed. Our goal was to learn and we have learned. Based on what we have learned, we can make a new hypothesis and plan a new experiment.
If you’re looking new job opportunities that offer relocation and high
salaries around the world check it out on our website Jobzey.com
It is possible that in most experiments we will prove that the hypothesis is false. This does not mean that we are wasting our time. It is natural that when facing new and complex problems we need to try many different approaches until we find one that works.
Data Science vs. Software Engineering. Data Science teams are like a laboratory. If we measure the progress of a Data Science team in the same way we measure the progress of the Software Engineering teams, we may reach the wrong conclusion that the Data Science team is not productive enough.
LOOKING for a JOB? Follow me. Not because I am an Influencer but because I sincerely care. I want to bring change to the recruiting process.
Even if one person gets a job, I would be the happiest person. Job searching is emotionally draining. No one should have to go through this alone.
I think everyone should support jobseekers’ posts. It takes a second, but may change someone’s life. LinkedIn isn’t only about entertainment. It’s about networking.
Let’s help each other out! “We cannot help everyone, but everyone can help someone.