Egypt (Remote)
To join our vibrant data engineering team, we are presently looking for a bright and driven data engineer. In order to ensure effective data import and export procedures for our data annotation projects, you will be a key player in the design, development, and maintenance of data pipelines. It is expected of LXT technical calibers to have a high degree of ownership and to be hands-on engineers who take over the duties until they are completed.
Accountabilities:
Data Transformation and Integration: Complete tasks related to data transformation and integration to guarantee that data from several sources is appropriately processed, prepared for annotation projects, and delivered to clients in accordance with client specifications.
Ensuring effective data storage, retrieval, and optimization to facilitate data annotation procedures is known as data manipulation.
Ensure the accuracy, consistency, and integrity of the data used in annotation projects by putting in place data quality assurance procedures and inspections.
Design and development of Data Pipelines: Work together with the Data Engineering team to create reliable, scalable data pipelines that are utilized to input and export data for our data annotation projects.
Performance Optimization: To improve the speed and effectiveness of data import and export procedures, locate and fix performance bottlenecks in data pipelines.
Automation and Process Improvement: To boost productivity, always look for ways to automate manual tasks and enhance workflows for data annotation.
Cooperation and Communication: To comprehend project needs and deliver timely data assistance, carefully collaborate with cross-functional teams, such as data annotation teams, backend developers, and project managers.
Documentation: To promote knowledge exchange and smooth project handovers, keep thorough records of data pipelines, processes, and data structures.
Troubleshooting and Support: Handle and resolve problems pertaining to data, including technical assistance to teams that annotate data as needed.
Keep Up with Emerging Technology: Keep up with the latest developments in data engineering tools, technologies, and industry trends. Also, suggest creative ideas for projects using data annotation.
a bachelor's degree in data engineering, computer science, or a similar discipline.
Demonstrated expertise in data engineering, with one to three years of practical experience in designing and implementing data pipelines, transforming data, and integrating data.
proficiency with data manipulation tools and libraries, as well as knowledge of programming languages like Scala, SQL, or Python.
strong familiarity with traditional and NoSQL databases, as well as data storage and database management technologies.
knowledge of methods and tools for data visualization to aid in the interpretation and analysis of data.
It is advantageous to have prior experience with cloud-based data systems like AWS, GCP, or Azure.
strong grasp of data governance and quality principles.
Expertise and familiarity with machine learning initiatives are highly advantageous.
excellent problem-solving abilities and an astute attention to detail.
Outstanding interpersonal and teamwork abilities, with the capacity to function well in a collaborative setting.a strong interest in data engineering and a willingness to help with important initiatives involving data annotation.
