Job description
OREDATA is a Digital Transformation & IT Consulting firm with 10+ years of proven expertise and hundreds of successfully implemented projects across the EMEA region. When you join the OREDATA team, you’ll be working hand-in-hand with experts focused on tackling digital, operational, analytical & data science challenges with the greatest impact. We foster collaboration with proximity, an agile and autonomous approach and best practices and guiding principles.
We are currently looking for a Senior Data Engineer on behalf of our client, a leading company in the aviation industry.✈️
Read more: https://medium.com/@oredata-engineering
Apply and be part of our exciting journey! 🚀
Key Responsibilities
Responsible for developing and maintaining customer profile management system, including data integration, data modeling and data migration.
Responsible for monitoring, measuring and improving the quality of customer profile data metrics and reducing any redundancy in the system.
Responsible for defining and enforcing policies and procedures for managing data assets, including product data quality, data stewardship, and reference data security.
Responsible for ensuring the accuracy, completeness and consistency of customer profile data across the organization
Responsible for analyzing customer profile data and data sources and identifying trends and patterns that can be used to improve business processes and operational efficiency, including data-driven decision-making
Design, develop, implement, and support our emerging big data analytics capabilities through the development and maintenance of advanced data ingestion, processing, modeling, and reporting capabilities
Design and implement new or enhanced data processes, tools or models
Working with stakeholders, provide operational and process execution and ongoing user support
Write a query to do almost anything
Process unstructured data into a form suitable for analysis – and then do the analysis if needed.
A bachelor’s degree or master’s degree in computer science, information technology, data engineering, software engineering, or a related field is preferred
Minimum 5 years of experience in a data-related role is expected for a data engineer role
Strong programming skills and proficiency in programming languages such as [Python, Java, Scala] are essential
Knowledge of data engineer skills such as data management, data visualization, and familiarity with data architecture is important
Experience in data processing frameworks like [Apache Spark, Apache Hadoop, or Apache Flink] is beneficial for handling and processing large-scale data sets efficiently
Database and query language expertise is preferred in database systems like [SQL, NoSQL]
Experience working with large volumes of metadata and schemas
Hands-on experience in designing, developing, and optimizing ETL processes using IBM DataStage or similar ETL tools such as informatica PowerCenter, Talend, or Apache NiFi.
Understanding how the role complements others working with [machine learning, data science, algorithms, business intelligence] is beneficial for collaboration
Experience with Message Broker Systems : Kafka, etc
Experience with data pipeline and workflow management tools: Airflow, Azkaban, Luigi, etc.
Experience with stream-processing systems: Storm, Spark-Streaming, etc.
Data warehousing knowledge, data modeling, cloud computing familiarity such as [AWS, Azure], and data security and governance understanding are all essential for the role
While not mandatory, data engineer certifications such as [Certified Data Engineer (CDE) or AWC Certified Big Data] are beneficial
Remote working and flexible time off
Opportunity to get company paid Professional Certificates (Google Cloud Platform, Confluent Kafka, etc)
Access to Online Training Platforms (Udemy, Pluralsight, A Cloud Guru, Coursera, etc.)
Opportunity to work on international projects
Private Health Insurance
Birthday Leave Policy
Dynamic work ecosystem where you can take initiative and responsibility
Open communication, flexibility and start-up spirit
Learning & Development opportunities for both personal and professional growth
Get to know us
If you want to know more about us and what we do, then visit our website: www.oredata.com
