Spark agent is an Aita agent specialize in writing spark code.
Example
python
from aita.agent.pyspark import PySparkAgent
from aita.datasource.postgresql import PostgreSqlDataSource
datasource = PostgreSqlDataSource("postgresql://localhost:5432/db")
spark_configs = {
"master": "local",
"appName": "Aita"
}
spark_agent = PySparkAgent(spark_configs, "gpt-3.5-turbo")
spark_agent.stream("I want to get the top customers which making the most purchases")