Senior Big Data Engineer

Grow your career with us

You are on a journey to join an exciting Company and be part of our success story to improve lives by developing resources sustainably. Here we offer you an exciting and dynamic work environment and will equip you with the know-how that will stretch and enhance your career journey.

Responsibilities:

You are on a journey to join an exciting Company and be part of our success story. Here we will equip you with the know-how and experience that will define your growth. In this role that you are about to embark on, you are required to carry out the following responsibilities:

1. Data Warehouse Design and Optimization• Design, develop, and maintain data warehouses in the manufacturing domain. Collaborate with cross - functional teams to understand business requirements and translate them into efficient data warehouse architectures. For example, design a data warehouse that integrates production, supply chain, and quality control data to support comprehensive manufacturing analytics.• Optimize data warehouse performance, including data loading, query execution, and storage management. Implement strategies such as partitioning, indexing, and data aggregation to improve the speed and efficiency of data retrieval. For instance, partition large production data tables by time or product category to reduce query response times.
2. Cloud - based Big Data Platform Management• Leverage cloud platforms (such as AliCloud,AWS, Azure, or Google Cloud) to build and manage big data ecosystems for manufacturing.• Ensure the scalability and high availability of the cloud - based big data infrastructure.
3. Data Ingestion and ETL Processes• Develop and maintain ETL (Extract, Transform, Load) processes to collect data from various manufacturing data sources, including sensors, production systems, ERP (Enterprise Resource Planning), and CRM (Customer Relationship Management) systems.• Implement data cleansing and quality control mechanisms within the ETL processes. Identify and correct data anomalies, missing values, and inconsistent data to ensure the integrity and accuracy of the data in the data warehouse. For instance, use data profiling tools to detect and clean up incorrect product codes in the production data.
4. Data Analytics and Insights• Collaborate with data analysts and business users to identify key performance indicators (KPIs) and develop data - driven solutions for manufacturing optimization. Use data mining and machine learning techniques to analyze manufacturing data and uncover insights, such as predicting equipment failures, optimizing production schedules, or improving product quality. For example, build a machine - learning model to predict when a manufacturing machine is likely to break down based on historical sensor data.• Provide technical support for data - related projects, including data visualization and reporting. Work with data visualization tools (such as Tableau or Power BI) to create interactive dashboards and reports that present manufacturing data in a meaningful way to non - technical stakeholders.

To be successful in this role, it is recommended that you should have the following skills and qualifications:

1. Education and Experience• A bachelor's or master's degree in Computer Science, Data Science, Engineering, or a related field.• At least 5 years of experience in big data engineering, with a focus on cloud - based platforms and data warehousing in the manufacturing industry. Experience in other industries may be considered if accompanied by a strong understanding of datawarehouse.

2. Technical Skills• Proficiency in cloud platforms, such as Alicloud,AWS, Azure, or Google Cloud• Solid knowledge of data warehousing concepts and technologies, including data modeling (e.g., dimensional modeling), database design, and SQL for querying and manipulating data in data warehouses.• Expertise in ETL tools and technologies, such as Maxcompute\Bigquery, for data ingestion and transformation. Familiarity with big data processing frameworks like Apache Hadoop and Spark is also highly desirable.• Programming skills in languages such as Python, Java, or Scala, which are commonly used in big data development and data analysis.

3. Soft Skills• Strong problem-solving and analytical skills, with the ability to translate complex manufacturing business problems into technical solutions.• Excellent communication and collaboration skills, as the role requires working closely with cross - functional teams, including data analysts, business users, and IT professionals.• Ability to work in a fast - paced and dynamic manufacturing environment, adapting to changing business requirements and data challenges.

4. Knowledge of Manufacturing Processes• In - depth knowledge of manufacturing processes, such as production planning, supply chain management, quality control, and lean manufacturing principles. This knowledge helps in better understanding manufacturing data and developing more relevant data solutions.

   Disclaimer:

   When you send us your resume and personal details, it is deemed you have provided your consent to us retaining your information in our talent recruitment database. All information provided will only be used for the recruitment process. RGE will only collect, use, process or disclose personal information where and when allowed to under applicable laws.

   Only shortlisted candidates will be contacted for an interview. We endeavour to respond to every applicant. However, if you do not receive a response from us within 60 days, please consider your application for this position unsuccessful. We may contact you in the future for any opportunities that match your qualifications and experience.

   Thank you for considering a career with RGE.

   #LI-RoyalGoldenEagle