职位描述
该职位还未进行加V认证,请仔细了解后再进行投递!
You will be reporting to the Engineering manager, you will work with Product Manager, other Engineering Team Members and with a variety of talented teammates. You will be part of team that will be a driving force in building Data and Analytic solutions for Technology.
Responsibilities:
1. Design and build reusable data assets for China data lake.
2. Anticipate, identify and solve issues concerning data management to improve data quality.
3. Clean, prepare and optimize data at scale for ingestion and consumption.
4. Implement complex automated workflows and routines using workflow scheduling tools.
5. Drive collaborative reviews of design, code, test plans and dataset implementation performed by other data engineers in support of maintaining data engineering standards.
6. Troubleshoot complex data issues and perform root cause analysis to proactively resolve product and operational issues.
7. Mentor and develop other data engineers in adopting best practices.
Requirements:
1. Above 4 years experiencing developing scalable data lake / data warehouse on top of big data platform.
2. Have deep Knowledge and experiences on Spark SQL / Hive SQL language, good knowledge of Presto or other MPP databases.
3. Have good experiences on Airflow or other data warehouse scheduling tools.
4. Have good experiences on data warehouse modeling.
5. Have good knowledge on AWS S3, EMR, lambda and AWS components or similar tech stack on other cloud.
6. Experiences on real time data processing, streaming data processing will be strong plus
7. Have experiences on Python programming
8. Strong skills building positive relationships across Product and Engineering.
9. Able to quickly pick up new programming languages, technologies, and frameworks.
10. Experience working in Agile and Scrum development process.
11. Fluent English skill (including oral and written English)
工作地点
地址:上海杨浦区上海-杨浦区三门路(地铁站)
![](http://img.jrzp.com/jrzpfile/cityrcw/SearchJob/images/jg.png)
![](https://img.jrzp.com/images_server/comm/nan.png)
职位发布者
HR
国际商业机器全球服务(大连)有限公司
![](http://img.jrzp.com/jrzpfile/cityrcw/images/sfrz_yrz.png)
-
IT服务·系统集成
-
51-99人
-
私营·民营企业
-
高新技术产业园区五一路269号302
相似职位
-
性能集成资深工程师(A216751) 17000-28000元天河区 应届毕业生 本科广州小鹏汽车科技有限公司
-
产品营销经理(A80394) 15000-25000元天河区 应届毕业生 本科广州小鹏汽车科技有限公司
-
自动驾驶传感器布置工程师(A101710) 25000-35000元天河区 应届毕业生 本科广州小鹏汽车科技有限公司
-
自动驾驶系统开发专家(车型专业经理) 30000-45000元天河区 应届毕业生 本科广州小鹏汽车科技有限公司
-
售后服务经理 9000-12000元越秀区 应届毕业生 大专中国人寿保险股份有限公司广州市第三支公司
-
兼职高中生物老师(6-15万年薪) 5000-10000元越秀区 应届毕业生 本科广州书香教育科技有限公司