Data Engineer
What Does a Professional in this Career Do?
A Data Engineer designs, builds and manages the information or big data infrastructure. Develops the architecture that helps analyze and process data in the way the organization needs it. Makes sure those systems are performing smoothly.
Job Outlook
There were 1498 Data Engineer job postings in North Carolina in the past year and 40192 in the United States.
In combination with other careers in the Data Engineer industry, which includes the Data Engineer career, the following graph shows the number of people employed for each year since 2015:
Salary
Many new Data Engineer jobs have salaries estimated to be in the following ranges, based on the requirements and responsibilities listed in job postings from the past year.
National
The average estimated salary in the United States for this career, based on job postings in the past year, is $126,509.
State
The average estimated salary in North Carolina for this career, based on job postings in the past year, is $124,502.
Percentiles represent the percentage that is lower than the value. For example, 25% of estimated salaries for Data Engineer postings in the United States in the past year were lower than $111,677.
Education and Experience
Posted Data Engineer jobs typically require the following level of education. The numbers below are based on job postings in the United States from the past year. Not all job postings list education requirements.
Education Level | Percentage |
---|---|
Associate's Degree | 0% |
Bachelor's Degree | 59.99% |
Master's Degree | 22.31% |
Doctoral Degree | 3.65% |
Other | 2.26% |
Posted Data Engineer jobs typically require the following number of years of experience. The numbers below are based on job postings in the United States from the past year. Not all job postings list experience requirements.
Years of Experience | Percentage |
---|---|
0 to 2 years | 12.28% |
3 to 5 years | 52.17% |
6 to 8 years | 23.12% |
9+ years | 12.44% |
Skills
Below are listings of the most common general and specialized skills Data Engineer positions expect applicants to have as well as the most common skills that distinguish individuals from their peers. The percentage of job postings that specifically mention each skill is also listed.
Baseline Skills
A skill that is required across a broad range of occupations, including this one.
- Communication (34.18%)
- Problem Solving (26.46%)
- Management (21.58%)
- Troubleshooting (Problem Solving) (19.09%)
- Operations (14.36%)
- Leadership (13.49%)
- Innovation (13.22%)
- Information Technology (10.92%)
- Research (9.93%)
- Mentorship (9.85%)
Defining Skills
A core skill for this occupation, it occurs frequently in job postings.
- Apache Airflow (14.14%)
- Azure Data Factory (10.26%)
- Data Lakes (14.63%)
- Agile Methodology (27.51%)
- Informatica (8.14%)
- Data Analysis (27.52%)
- Big Data (25.6%)
- Microsoft Azure (30.38%)
- Computer Science (44.97%)
- Extract Transform Load (ETL) (49.28%)
- Data Quality (24.99%)
- Apache Hadoop (14.8%)
- Scalability (31.3%)
- Amazon Web Services (39.01%)
- Java (Programming Language) (21.59%)
- Data Modeling (36%)
- Scala (Programming Language) (16.8%)
- Data Infrastructure (9.39%)
- Data Warehousing (38.61%)
- Apache Spark (29.6%)
- Apache Hive (8.97%)
- Data Engineering (83.24%)
- PySpark (11.55%)
- Databricks (15.52%)
- Python (Programming Language) (65.35%)
- SQL (Programming Language) (66.87%)
- Data Ingestion (9.46%)
- Data Pipelines (43.02%)
- Amazon Redshift (14.29%)
Necessary Skills
A skill that is requested frequently in this occupation but isn’t specific to it.
- Workflow Management (16.55%)
- Application Programming Interface (API) (16.56%)
- Git (Version Control System) (9.76%)
- Business Intelligence (19.2%)
- Data Architecture (12.9%)
- Information Systems (8.22%)
- Version Control (7.61%)
- Data Processing (14.33%)
- Data Security (8.42%)
- Data Management (15.83%)
- Linux (7.36%)
- Data Visualization (12.12%)
- Google Cloud Platform (GCP) (10.69%)
- MySQL (7.93%)
- Automation (20.98%)
- Artificial Intelligence (10.6%)
- Amazon S3 (11.61%)
- Business Requirements (13.06%)
- Machine Learning (20.72%)
- Software Development (11.21%)
- NoSQL (13.8%)
- Code Review (6.16%)
- Data Structures (8.4%)
- Power BI (14.92%)
- Statistics (7.74%)
- Dashboard (10.89%)
- DevOps (11.69%)
- Relational Databases (12.32%)
- Data Governance (15.37%)
- R (Programming Language) (8.5%)
- CI/CD (15.83%)
- Data Integration (15.52%)
- Jenkins (6.18%)
- Kubernetes (7.82%)
- Docker (Software) (7.23%)
- Project Management (8.85%)
- PostgreSQL (10.53%)
- Tableau (Business Intelligence Software) (14.39%)
- Scrum (Software Development) (7.58%)
- Software Engineering (13.3%)
- Data Storage (7.82%)
- Data Science (19.62%)
- Scripting (13.84%)
- Terraform (6.38%)
- Apache Kafka (15.72%)
- Programming Languages (13.17%)
Distinguishing Skills
A skill that may distinguish a subset of the occupation.
- Azure Data Lake (3.18%)
- AWS Kinesis (3.71%)
- AWS Glue (4.1%)
- BigQuery (5.76%)
- Dataflow (5.79%)
- Azure Databricks (3.84%)
- Data Transformation (6.84%)
- Distributed Data Store (3.46%)
- Data Store (5.48%)
- SQL Server Integration Services (SSIS) (6.53%)
- Transact-SQL (3.98%)
- Unstructured Data (6.61%)
- Real Time Data (5.66%)
- Synapse Citrix (3.17%)
- DataOps (3.56%)
- Azure Synapse Analytics (4.13%)
Salary Boosting Skills
A professional who wishes to excel in this career path may consider developing the following highly valued skills. The percentage of job postings that specifically mention each skill is listed.
- Data Lakes (18.09%)
- AWS Kinesis (4.58%)
- AWS Glue (5.08%)
- Azure Databricks (4.75%)
- Amazon Web Services (48.24%)
- Computer Science (55.62%)
- Distributed Data Store (4.28%)
- Scalability (38.71%)
- Scala (Programming Language) (20.77%)
- Synapse Citrix (3.92%)
- Apache Spark (36.61%)
- Real Time Data (7%)
Alternative Job Titles
Sometimes employers post jobs with Data Engineer skills but a different job title. Some common alternative job titles include:
- Lead Data Engineer
- Database Engineer
- Azure Engineer
- Big Data Engineer
- Analytics Engineer
- Principal Engineer
- Staff Data Engineer
- Data Integration Engineer
- Master Data Engineer
Similar Occupations
If you are interested in exploring occupations with similar skills, you may want to research the following job titles. Note that we only list occupations that have at least one corresponding NC State Online and Distance Education program.
- ETL Developer
- Data Warehouse Developer
- Database Analyst / Developer
- Database Architect
- Data Manager
- Business Intelligence Developer / Architect
- SQL Developer
Common Employers
Here are the employers that have posted the most Data Engineer jobs in the past year along with how many they have posted.
United States
- Amazon (633)
- Insight Global (589)
- Ford (490)
- Capital One (466)
- Motion Recruitment (416)
- Randstad (390)
- Kforce (380)
- Robert Half (367)
- Beacon Hill Staffing Group (305)
- The Judge Group (288)
North Carolina
- Randstad (65)
- Insight Global (28)
- Motion Recruitment (22)
- Robert Half (22)
- The Hartford (21)
- Kforce (20)
- Infosys (19)
- Eliassen Group (19)
- Fidelity Investments (17)
- Jobot (17)
NC State Programs Relevant to this Career
If you are interested in preparing for a career in this field, the following NC State Online and Distance Education programs offer a great place to start!
- Agriculture Data Science Graduate Certificates
- Data Science Foundations Graduate Certificates
- Foundations of Data Science Master's Degrees
- Statistics Master's Degrees
All wages, job posting statistics, employment trend projections, and information about skill desirability on this page represents historical data and does not guarantee future conditions. Data is provided by and downloaded regularly from Lightcast. For more information about how Lightcast gathers data and what it represents, see Lightcast Data: Basic Overview on Lightcast's Knowledge Base website.