IBM off campus drive
- Company name: IBM
- Website: ibm.com
- Job Position: Data Engineer
- Location: Kochi
- Job Type: Full time
- Experience: Freshers
- Qualification: B.E/ B.Tech/ M.E/ M.Tech
- Batch: 2019/ 2020/ 2021/ 2022/ 2023
- Salary: Up to 12 LPA (Expected)
IBM off campus drive is recruiting candidates for Data Engineer position. Candidates who completed B.E/ B.Tech/ M.E/ M.Tech are eligible can apply for this job. The required details such as the agenda, eligibility, procedure, and application process are provided below
Job responsibilities:
- Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements.
- Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization.
- Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too.
Skills Required:
- Developed the Pysprk code for AWS Glue jobs and for EMR.. Worked on scalable distributed data system using Hadoop ecosystem in AWS EMR, MapR distribution..
- Developed Python and pyspark programs for data analysis.. Good working experience with python to develop Custom Framework for generating of rules (just like rules engine).
- Developed Hadoop streaming Jobs using python for integrating python API supported applications..
- Developed Python code to gather the data from HBase and designs the solution to implement using Pyspark. Apache Spark DataFrames/RDD’s were used to apply business transformations and utilized Hive Context objects to perform read/write operations..
- Re – write some Hive queries to Spark SQL to reduce the overall batch time
Preferred Technical and Professional Expertise:
- Understanding of Devops.
- Experience in building scalable end-to-end data ingestion and processing solutions
- Experience with object-oriented and/or functional programming languages, such as Python, Java and Scala”