I'm an enthusiastic Associate Data Engineer at iLabs and a former Intern Data Engineer at Wiley. I have a strong passion for designing and optimizing data lakehouse architectures using open-source technologies. My expertise spans real-time data processing, metadata-driven ETL workflows, and cloud infrastructure.
Iβm a data engineer who wants to be involved in infrastructure. I enjoy diving into the systems sideβsetting up tools and controlling how everything operates.
{
"introduction": {
"greeting": "Hi there! I'm Rajith Lahiru π",
"aboutMe": "I'm an enthusiastic Associate Data Engineer at iLabs and a former Intern Data Engineer at Wiley. I have a strong passion for designing and optimizing data lakehouse architectures using open-source technologies. My expertise spans real-time data processing, metadata-driven ETL workflows, and cloud infrastructure.",
"highlights": [
"π Data Engineer specializing in real-time data processing",
"β‘ Enthusiast in data infrastructure and system operations",
"π Experience with metadata-driven ETL architectures",
"βοΈ Cloud knowledge (AWS EC2, S3)",
"π οΈ Passionate about open-source technologies"
]
},
"skills": {
"programmingLanguages": ["Python", "SQL", "Java", "C++", "JavaScript"],
"frameworksAndLibraries": ["Apache Spark", "Debezium", "Kafka", "Pandas", "Airflow", "Trino"],
"toolsAndPlatforms": ["Docker", "Git", "Jenkins", "Hive Metastore", "PostgreSQL", "Snowflake"],
"cloud": ["AWS EC2", "AWS S3"]
},
"experience": [
{
"role": "Associate Data Engineer",
"company": "iLabs",
"description": "Working on data lakehouse architectures with real-time data processing using Debezium, Kafka, PySpark, and Trino."
},
{
"role": "Intern Data Engineer",
"company": "Wiley",
"description": "Worked on metadata-driven ETL workflows, leveraging PostgreSQL to Snowflake with Pandas and Apache Airflow."
}
],
"contact": {
"LinkedIn": "https://www.linkedin.com/in/rajithlahiru/",
"Portfolio": "rajithlahiru.me",
"Email": "[email protected]"
},
"funFacts": [
"π I enjoy exploring data infrastructure and automation.",
"π Avid learner of open-source technologies.",
"π Always eager to optimize workflows and improve efficiency."
],
"closing": "Feel free to reach out to me for collaboration on projects, discussing data engineering trends, or just to say hi!",
"signature": "*This README was generated with β€οΈ by Rajith Lahiru*"
}