escription and Location
4+ years in data operations, platform support or IT assurance roles.
?Working knowledge on data lake architecture and storage formats
?Understanding of data partitioning, schema evolution and reconciliation
?String proficiency in SQL for any Data quality checks verification
?Ability to write scripts for Data validation and verification during the migration
?Understanding of data governance principle, metadata management and regulatory principles
?Scripting and Automations skills (expertise in Spark, Hive using python)
4年以上工作經(jīng)驗 英語溝通
描述與地點
? 在數(shù)據(jù)運營、平臺支持或IT審計相關(guān)崗位上有4年工作經(jīng)驗。
? 熟悉數(shù)據(jù)湖架構(gòu)和存儲格式
? 理解數(shù)據(jù)分區(qū)、模式演變及數(shù)據(jù)對賬x
? 精通用于數(shù)據(jù)質(zhì)量檢查驗證的SQL
? 能夠在遷移過程中編寫數(shù)據(jù)驗證和核查腳本
? 理解數(shù)據(jù)治理原則、元數(shù)據(jù)管理及法規(guī)要求? 具備腳本編寫和自動化技能(精通使用Python進行Spark和Hive操作)