Data Engineer Job at I-cube Software Llc, Canada

UXdHSVdoekQxU3B4SGw5SU1JU0ZSRHhkRWc9PQ==
  • I-cube Software Llc
  • Canada

Job Description

Job Description

Job Description

Hybrid Hadoop Engineer and Hadoop Infrastructure Administrator to build and maintain a scalable and resilient Big Data framework to support Data Scientists. As an administrator, your responsibility will be to deploy and maintain Hadoop clusters, add and remove nodes using cluster management and monitoring tools like Cloudera Manager, and support performance and scalability requirements, in support of our Data scientist's needs. Some Relational Database administrator experience will also be desirable to support the general administration of Relational Databases.

Design, build, and maintain Big Data workflows/pipelines to process a continuous stream of data with experience in end-to-end design and build process of Near-Real-Time and Batch Data Pipelines.


Demonstrated work experience in the following with Big Data and distributed programming models and technologies
Knowledge of database structures, theories, principles, and practices (both SQL and NoSQL).
Active development of ETL processes using Spark or other highly parallel technologies, and implementing ETL/data pipelines
Experience with Data technologies and Big Data tools, like Spark, Kafka, Hive
Understanding of Map Reduce and other Data Query and Processing and aggregation models
Understanding of challenges of transforming data across distributed clustered environment
Experience with techniques for consuming, holding, and aging out continuous data streams
Ability to provide quick ingestion tools and corresponding access APIs for continuously changing data schema, working closely with Data Engineers around specific transformation and access needs

Preferred:

Experience as a Database administrator (DBA) will be responsible for keeping critical tools database up and running
Building and managing high-availability environments for databases and HDFS systems
Familiarity with transaction recovery techniques and DB Backup

Skills and Attributes:

Ability to have effective working relationships with all functional units of the organization
Excellent written, verbal, and presentation skills
Excellent interpersonal skills
Ability to work as part of a cross-cultural team
Self-starter and Self-motivated
Ability to work without lots of supervision
Works under pressure and is able to manage competing priorities.

Hide

Job Tags

Work experience placement,

Similar Jobs

Renaissance Learning North America

Data Analyst I Job at Renaissance Learning North America

About Renaissance When you join Renaissance, you join a global leader in pre-K12 education technology! Renaissances solutions help educators analyze, customize, and plan personalized learning paths for students, allowing time for what matterscreating energizing ...

Adidev Technologies Inc

React Native Hybrid Developer Onsite, Fast Ramp-Up Job at Adidev Technologies Inc

 ...innovative software consulting firm is urgently seeking talented Hybrid Developers to join their dynamic team. This role offers the opportunity to...  ...-scale applications for well-known clients. With a focus on React Native, candidates will need to demonstrate their ability to... 

Care Options For Kids

Childcare Clinical Nurse Specialist (DENVER) Job at Care Options For Kids

 ...empowered to make a real difference in your clients' lives. We value your clinical knowledge and respect the deep one-on-one bond you establish with the families you care for. Benefits for Registered Nurses (RNs)~ Paid Time Off (PTO) and flexible schedule ~ Medical,... 

10-4 Truck Recruiting

CLASS A- LOCAL-HOME DAILY- TRUCK DRIVER- 0 EXPERIENCE NEEDED Job at 10-4 Truck Recruiting

 ...Class A CDL Solo LOCAL Truck Driver - GET STARTED RIGHT AWAY! *****Please read to make sure you qualify :) POSITION DETAILS:...  ...REQUIREMENTS: Must be at least 21 Years of Age No experience necessary. Must have a valid CDL No Sap drivers Clean criminal... 

Leap Brands

Vice President of Marketing - Restaurants Job at Leap Brands

 ...Position Overview We are seeking a dynamic and strategic Vice President of Marketing to lead the development and execution of all marketing initiatives for our franchisor restaurant brand. This executive will be responsible for building brand equity, driving franchisee...