[İş Radarı](https://jobradar.live/) / [Jobs](https://jobradar.live/ilanlar) / DATA ENGINEER

Active
On-site
New York, NY, United States
Posted · 30.06.2016
SmartRecruiters (US)

# DATA ENGINEER

Carnegie Affiliates

Responsibilities: Design and develop high-throughput, low-latency data processing pipelines to quickly ingest and make data available on the platform across various distributed data stores Analyze large datasets to identify opportunities to tune and improve the system Experiment with various Hadoop frameworks like Hive, Pig and Scalding to identify the optimal approach for extracting valuable insights from massive datasets Tool We Used: Scala Hadoop (Hive, Pig, Scalding, Spark) Kafka MySQL, Redis, Vertica, Aerospike Requirements: Bachelors or Masters in Computer Science or related field 3+ years of experience ingesting, processing, storing and querying large datasets Professional Hadoop ecosystem experience, including storage optimization and job performance tuning Expertise in Java, Python or similar language(s). Functional programming experience is a plus Passion for code correctness and intuition about which values in data are to be expected in a business context All your information will be kept confidential according to EEO guidelines. Major Corporation

This job was verified from SmartRecruiters (US). Applications are completed on the original source.

[Apply on the original listing ↗](https://jobradar.live/ilan/f4c08b45-03b9-4127-af92-41130e3dfbc3/git)

## Stop searching one by one for roles like this.

Upload your resume or enter your target roles to see your first 3 matches for free.

[Find jobs for me →](https://jobradar.live/uye/kayit)
Your resume is never shared with employers; it is processed only for matching.

Something wrong with this job?