Tried to book a meeting. LLM thought tomorrow was 'too' far into the future. Backend prompt must make it think it's 2024

Bugs / Site Issues
1

Pickaxe LLM/Prompt thinks it’s 2024.

image
image2224×1378 290 KB

1 Like
2

@ai1offs, LLMs have no awareness of today. They reflect content – including dates and times --associated with the date of their training. ChatGPT knows today’s date and time and other current information because it’s been specially programmed to get that from the Web. By using the “Google Search” action, you can instruct a Pickaxe to access a site like https://www.time.gov/ and look up the date. It’s not ideal because it takes maybe 15 seconds. In my experimentation, it retrieves the date correctly, but I haven’t gotten it to give the correct time. Maybe in the future Pickaxe could add something like an environment variable that could provide instant access to date and time.

4

I would want to agree with you if things weren’t a little different nowadays.
If you ask the same question in the ChatGPT ui with the same model, it’ll give you the date and time.

image
image1956×1459 95.7 KB

5

That’s because ChatGPT’s system prompt is obtaining the date/time… and Pickaxe doesn;t actually use ChatGPT’s system prompt like you have accessed it - instead, it bypasses it to use the API so you need to wrangle this yourself. I do it via a custom action (see below) and depending upon which model you are using, it can be quite quick. See it in action here

import requests
from datetime import datetime
import pytz

def get_current_time_for_athleet_ai_hq():
    """
    Gets the current Date if the user asks for it.

    """

    # Insert your PYTHON code below. You can access environment variables using os.environ[].
    # Currently, only the requests library is supported, but more libraries will be available soon.
    # Use print statements or return values to display results to the user.
    # If you save a png, pdf, csv, jpg, webp, gif, or html file in the root directory, it will be automatically displayed to the user.
    # You do not have to call this function as the bot will automatically call and fill in the parameters.
   # Define the London timezone
london_timezone = pytz.timezone("Europe/London")

# Get the current time in London
london_time = datetime.now(london_timezone)
    
# Format the time as a string
formatted_london_time = london_time.strftime("%d-%m-%Y %H:%M:%S %Z")
    
print(formatted_london_time)```