8
(2017) Rise of the Data Engineer
(medium.com)
A community for discussion about data engineering
Icon base by Delapouite under CC BY 3.0 with modifications to add a gradient
Just a comment on this note: At my company, I started changing our job posting titles from “Data Engineer” to “Software Engineer, Data.” “Data Engineer” is such a loose title which seems to change definition from company to company. I found that those “data engineer” postings attract lots of applicants who know enough SQL to be dangerous and programming wise- didn’t know much beyond making a “hello world” or a calculator in a single Python script. Software “best practices” and design principles were no where to be found. Those applicants were more “data analytics engineers” than “developers.”
Once job titles changed to “software” engineering, we got the engineers we were looking for.
That seems like a good idea by removing ambiguity about what the necessary skills are.
When joining a new company, I once asked a wise colleague “are you a data engineer or a backend engineer?”. They replied “I’m a software engineer” and ever since I have given the same answer, for reasons similar to your post.
I have also seen “data engineer” used at facebook to indicate someone who writes SQL but not other programming languages, another potential reason not to use this as a job title IMO.