Data Engineer

Our large client is looking for a Remote Data Engineer for long term conrtcat opportunity.

This role requires a strong technical foundation in big data technologies, cloud-based data solutions, and data pipeline automation, along with excellent communication and problem-solving skills.

Key Skills:

• Python
• Spark
• SQL
• Hive
• Data Modeling
• Data Warehousing
• Spark Streaming Experience
• Strong Communication Skills

Job Responsibilities:

• Design and implement scalable database management systems, ensuring data integrity, security, and optimal performance.
• Develop and maintain data pipelines and ETL processes to support efficient data ingestion, transformation, and storage.
• Establish and enforce data standards, quality assurance practices, and best practices for database development and maintenance.
• Evaluate, install, and optimize database management systems, ensuring seamless integration with existing infrastructure.
• Design and document database structures, including conceptual and logical models, data capacity planning, and security policies.
• Build and enhance real-time data streaming solutions using Spark Streaming for faster insights and analytics.
• Collaborate with cross-functional teams to support business application development, testing, and UI design where data interaction is required.
• Assist in developing data specifications and schema definitions, ensuring optimal data storage, retrieval, and relational integrity.
• Optimize database queries and enhance performance tuning strategies to improve efficiency and system responsiveness.
• Work closely with stakeholders to understand business requirements and translate them into effective data solutions.