Blog: ChatGPT Prompt Engineering for Developers
Two Types of LLM
-
Base LLM:
- Predicts next word, based on text training data.
-
Instruction Tuned LLM
- Fine-tune on instructions.
- RLHF: Reinforcement Learning with Human Feedback.
Guidelines
-
Principle 1: Write clear and specific instructions.
-
Tactic 1: Use Delimiters.
- Tactic 2: Ask for structured outputs.
- Tactic 3: Ask model to check …
Continue reading
Blog: Connect Jupyter Notebook to AWS Glue Endpoint
Posted on Thu 12 November 2020 in blogs • Tagged with devops
If I am not wrong, then almost everyone in data engineering industry have heard of Apache Spark and if not (highly unlikely) then you are just one google search away for ample number resources. This post will revolve around Spark, AWS Glue, notebook and binding these tools for optimal results …
Continue reading
Exploring ML Tools - Transcribe
Audio is part of our life which exists in many forms like, voice messages, podcasts, songs, lectures, recorded conversations etc. These files are really hard to process by computer and so it just stays in magnetic disk or expensive disk and never actually used proactively unless its needed. However, machines …
Continue reading
Exploring ML Tools - AWS Translate
According to one of the surveys there are roughly 6500 languages spoken in whole world. However, I am sure that actual number is definitely more. So, it 99.9% impossible to learn all the languages in the world, but we as human are always keen to know the unknowns. So …
Continue reading
Exploring ML Tools - Amazon Forecast
This post will focus on forecasting services offered by Amazon Web Service called as AWS Forecast. Companies have been performing forecast on business outcome since long time spanning from financial market forecast to retail product demand forecast. Earlier Statistical methods and Advanced Mathematics have been used to predict the future …
Continue reading
Exploring ML Tools - Amazon Textract
Documents have been part of our lives since very long time, however, its not always so easy to find something in document. With the new advances in machine learning we can actually digitize our document and thus put it to good use.
Introduction
In this post, we will be exploring …
Continue reading
Blog: AWS GluePyspark Locally
Download and install maven
- Download maven from https://aws-glue-etl-artifacts.s3.amazonaws.com/glue-common/apache-maven-3.6.0-bin.tar.gz
- untar the content to respective folder
For example,
mv apache-maven-3.6.0 {HOME}/Documents/opt/apache-maven
-
Add mvn to your path
bash echo 'export PATH=$PATH:/Users/bhavintandel/Documents/opt/apache-maven/bin' …
Continue reading