This is the multi-page printable view of this section. Click here to print.

Return to the regular view of this page.

Learning

How to use Foyle to learn from human feedback

    What You’ll Learn

    How to configure Foyle to continually learn from human feedback

    Configure Foyle to use RAG

    To configure Foyle to use RAG

    foyle config set agent.rag.enabled=true
foyle config set agent.rag.maxResults=3

    Enabling Logging In RunMe

    If you are using RunMe.dev as the frontend for Foyle then you need to configure RunMe to enable the AI logging experiment

    1. Inside vscode open the settings panel
    2. Enable the option Runme › Experiments: Ai Logs

    Now that logging is enabled. You can verify that the logs are being written and identify the location of the logs.

    Inside VSCode open an output window and select the RunMe output channel. Scroll to the top of the messages and look for a Logger initialized message like the one below

    [2024-05-28T22:12:20.681Z] INFO Runme(RunmeServer): {"level":"info","ts":1716934340.6789708,"caller":"cmd/common.go:190","msg":"Logger initialized","devMode":false,"aiLogs":true,"aiLogFile":"/Users/jlewi/Library/Application Support/runme/logs/logs.2024-05-28T15:12:20.json"}

    The field aiLogs will contain the file that the current instance of RunMe is using for the JSON logs.

    By default, on MacOs RunMe will use the directory

    /Users/${USER}/Library/Application Support/runme/logs/

    Configuring Learning

    If you are using RunMe.dev as the frontend for Foyle then you need to configure Foyle with the location of the directory of RunMe’s logs. Refer to the previous section for instructions on how to locate the file where RunMe is writing the logs. Then remove the filename to get the directory where the logs are being written.

    Once you know the directory run the following command to configure Foyle to use that directory

    foyle config set learner.logDirs=${RUNME_LOGS_DIR}

    Sharing Learned Examples

    In a team setting, you should build a shared AI that learns from the feedback of all team members and assists all members. To do this you can configure Foyle to write and read examples from a shared location like GCS. If you’d like S3 support please vote up issue #153.

    To configure Foyle to use a shared location for learned examples

    1. Create a GCS bucket to store the learned examples

       gsutil mb gs://my-foyle-examples

    2. Configure Foyle to use the GCS bucket

      foyle config set learner.exampleDirs=gs://${YOUR_BUCKET}

    Optionally you can configure Foyle to use a local location as well if you want to be able to use the AI without an internet connection.

    foyle config set learner.exampleDirs=gs://${YOUR_BUCKET},/local/training/examples