Join me as I dive into another AWS platform architecture for Gen AI, specifically designed for an enhanced job search experience! I’ll share my thoughts as an engineer on how this innovative setup works, featuring Bedrock, Gen AI, ECS, and EC2.
Curious about the tech behind it and my take on its strengths and improvements? Watch now and let me know your thoughts in the comments!
Find the link to the original video in the description below👇
#dataengineer #dataengineering #datascience #aws #awsarchitecture #genai #generativeai #jobsearchengine #reactionvideo
+++++
▶︎ Watch the AWS video: https://youtu.be/7KqYdneuJjo?si=rQb2hSQXaThn7tK8
▶︎Link to my Architecture Review Playlist on Youtube: https://youtube.com/playlist?list=PLYUMVUCNosJdIjyQfPl27sjZm2E9_3TNG
►Learn Data Engineering with my DATA ENGINEERING ACADEMY:
https://bit.ly/3R13ao0
►Follow me on LinkedIn for your DAILY DOSE of Data Engineering:
https://www.linkedin.com/in/andreas-kretz/
►Data Engineering SKILLS & TOOLS GUIDE:
-Get insight into skills and tools engineers use to build platforms & pipelines. Including example projects you can start with today!
https://hello.learndataengineering.com/quickstart-guide
►LEARN MORE about Data Engineering:
-Check out my free 100+ page data engineering cookbook on GitHub:
https://bit.ly/3SKqmq7
+++++
Hey there! I’m Andreas Kretz, your guide to the world of Data Engineering and founder of the Learn Data Engineering Academy.
On this channel, I break down complex concepts and share insights from my day-to-day work. Tune in for livestreams where I chat with data experts, dive into workshops, and get hands-on with the latest tools and platforms like AWS, GCP, Apache Spark, dbt, Snowflake, Python, Databricks, Apache Airflow, and more. I also do reviews and reactions to various tools and architectures, giving you an inside look at what’s hot in the data world.
If you’re passionate about Data Engineering, eager to learn, or curious about the latest tools and techniques, hit subscribe. Let’s explore the world of Data Engineering together!
P.S.: Check out my @plumbersofdatascience podcast for episodes every Monday and Friday, where I tackle various Data Engineering topics. I also feature “Hero Talks” with guest Data Engineers discussing their journeys, job insights, and more.
source
date: 2024-07-27 16:00:36
duration: 00:11:41
author: UCY8mzqqGwl5_bTpBY9qLMAA
Data Engineer Reacts: AWS Architecture With Generative AI Enabled Job Search Engine
In this video, a data engineer and representatives from AWS and Healthy Careers walk through an AWS architecture for a generative AI-enabled job search engine. The system allows users to search for jobs using a natural language query, such as "Cardiology jobs in Southern California." The architecture uses various AWS services, including ECS, S3, and Lambda.
The system starts with a chatbot that takes in the user’s query and passes it to a Cloud infrastructure, which uses a net application to sanitize and enrich the prompt. The enriched prompt is then passed to Bedrock, which uses Claude 2 to check for prompt injection and geolocation features. The system also uses Titan to vectorize the prompt and enhance the search experience.
The enriched query is then passed to a SQL instance on EC2, which retrieves the user’s search history. The system then uses Elastic Search to search the job descriptions and retrieve relevant results. The results are then used to generate a generative AI response, which is passed back to the user.
The system also includes a process that updates the Elastic Search index every 6 hours by pulling in new job postings from various sources. The system views success as further interactions with the job results and is seeing an 80% interaction rate with the results.
The video is a great example of how generative AI can be used to enhance the job search experience and provide a more intuitive and user-friendly interface for users.
Error: unable to get links from server. Please make sure that your site supports either file_get_contents() or the cURL library.
