2.png)
"Your Needs Our Mission"
Data Engineer
- Job Title
- Data Engineer
- Job ID
- 27732929
- Work Remote
- Yes
- Location
- remote,
- Other Location
- Description
-
Seeking a Data Engineer with strong background designing, implementing, and optimizing data pipelines, including building data pipelines from scratch. High proficiency developing complex data processing solutions in a SQL Server / Azure SQL Server environment is required.
Duties and Responsibilities:- Design, develop, and optimize end-to-end data pipelines utilizing ETL processes, ensuring scalability, reliability, and high-performance.
- Perform data cleansing, data integration, and data QA/QC activities to maintain the accuracy and integrity of large datasets.
- Identify, design, and implement data processing improvements, such as automating manual processes, optimizing data delivery, enhancing process performance, etc.
- Troubleshoot data-related problems and provide innovative solutions to address complex data challenges.
- Provide technical expertise in code analysis, debugging, and troubleshooting.
- Ensure that all deliverables developed are high quality, thoroughly tested, and appropriately documented, including conducting comprehensive functional testing.
- Work with team to keep standard procedures, how-to guides, and other team documentation current.
- 5+ years of data engineering experience, including design and implementation of ETL processes to establish and improve data pipelines.
- 5+ years of experience with data processing in Microsoft SQL Server / Azure SQL databases, including high proficiency in writing efficient SQL queries, stored procedures, functions, etc. for complex data tasks.
- 3+ years programming data solutions, including development using .NET (C#), Python, and Java or Scala.
- Demonstrated understanding of database and schema design principles, data integrity, and data governance practices.
- Strong problem-solving skills and ability to troubleshoot/solve complex data-related issues.
- Experience using version control system such as Git.
- Bachelor’s Degree, preferably in a quantitative discipline such as Computer Science, Software Engineering, or Mathematics.
- Ability to obtain a DoD SECRET clearance.
- Experience with statistical software and data analysis tools, such as R.
- Experience with data analytics engines, such as Apache Spark.
- Experience developing solutions using Azure data processing services, such as Azure Data Factory, Synapse Analytics, Stream Analytics, and/or Databricks.
- Experience in development of Department of Defense enterprise applications.
- Required Skills
-
5+ years of data engineering experience, including design and implementation of ETL processes to establish and improve data pipelines.
5+ years of experience with data processing in Microsoft SQL Server / Azure SQL databases, including high proficiency in writing efficient SQL queries, stored procedures, functions, etc. for complex data tasks.
3+ years programming data solutions, including development using .NET (C#), Python, and Java or Scala.
Demonstrated understanding of database and schema design principles, data integrity, and data governance practices.
Strong problem-solving skills and ability to troubleshoot/solve complex data-related issues.
Experience using version control system such as Git.
Bachelor’s Degree, preferably in a quantitative discipline such as Computer Science, Software Engineering, or Mathematics.
Ability to obtain a DoD SECRET clearance.
