求才內容說明

職務編號:

HW206548

職務類別:

系統/軟韌體

職務說明:

1. Design, develop, and maintain ETL / ELT data pipelines, including data ingestion, parsing, transformation, validation, and export.
2. Modularize, standardize, and automate existing script-based or manual processes, and define clear pipeline interfaces, dependencies, and processing flows.
3. Establish monitoring, logging, error handling, retry, failure recovery, and data validation mechanisms to ensure pipeline reliability and data quality.
4. Analyze and optimize data processing performance, reliability, and scalability.
5. Collaborate with Database Engineers and Automation / DevOps Engineers to integrate databases, NAS / file storage, and workflow orchestration platforms.
6. Create and maintain relevant architecture, interface, operation, and troubleshooting documentation.

工作地點:

基隆/台北

薪  資:

面議

專長條件:

1. 3+ years of experience as a Data Engineer, Data Platform Engineer, Backend Engineer, or in a related role.
2. Strong proficiency in Python, SQL, and Linux, with hands-on experience in production-level data processing.
3. Hands-on experience in ETL / ELT, data pipeline architecture, and data processing workflow design and implementation.
4. Hands-on experience with Airflow, Dagster, Prefect, or other workflow orchestration frameworks.
5. Practical experience with pipeline monitoring, logging, error handling, retry, failure recovery, and data validation / data quality mechanisms.
6. Ability to independently perform system design, debugging, root cause analysis, performance optimization, and production issue handling.
7. Familiarity with Git, Shell scripting, and software engineering practices, with the ability to build maintainable and scalable data pipelines.
8. Ability to communicate effectively in English in technical discussions, meetings, and cross-functional collaboration.

【Preferred Qualifications】
1. Experience processing large volumes of image, video, sensor / IoT, metadata, or other unstructured data.
2. Experience with Docker, REST APIs, message queues, event-driven architecture, or other system integration technologies.
3. Experience with Spark / PySpark, Kafka, or other distributed data processing frameworks.
4. Experience with Data Modeling, Data Governance, Data Lineage, Dataset Versioning, or Data Traceability.
5. Experience with Pandas, NumPy, data analysis, Machine Learning, or Computer Vision.
6. Experience in automotive product development, or familiarity with standards and development processes such as Automotive SPICE, ISO 26262, or ISO/SAE 21434.

企業背景

產業類別:

電子/電腦/週邊

公司背景:

上市電腦大廠

我想了解

如果您對這項職務感興趣,請輸入您在本站的會員帳號及密碼,
我們會為您推薦給負責的顧問,協助您應徵此職務。
會員帳號:   登入密碼:
送出
如果您尚未成為百萬年薪求才網之會員,請點選此處:
申請會員