Data Engineer
Establishes database management systems, standards, guidelines, and quality assurance protocols for database deliverables, including conceptual design, logical databases, capacity planning, external data interface specifications, data loading plans, data maintenance strategies, and security policies. Documents and communicates database designs effectively. Evaluates and installs database management systems, codes complex programs, and derives logical processes on technical platforms. Builds user interfaces, screens, and reports, while assisting in the design of business application prototypes. Participates in quality assurance and develops test application code in a client-server environment. Provides expertise in defining and negotiating the structure of tables and fields in the database. Adapts business requirements developed by modeling and systems engineering teams, creating data specifications and defining table and element attributes for applications. At advanced levels, aids in understanding clients’ original data and storage mechanisms, determining data suitability for storage and optimal organization. Assesses relationships between tables and interactions among fields within a relational model.
Qualifications:
- Bachelor’s or Master’s degree in Computer Science or a related technical field, or an equivalent combination of education and experience.
- 7+ years of relevant experience in data engineering.
- Experience building scalable, high-performance cloud data lake solutions.
- Familiarity with technologies such as Spark and Airflow.
- Preferred experience with platforms like Databricks or AWS for developing big data pipelines.
- Proficiency with source control tools like GitHub and related CI/CD processes.
- Strong problem-solving and analytical skills.
- Proven ability to influence and communicate effectively with team members and business partners.