Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Up-to-date gold results #47

Open
xxxbrem opened this issue Jan 18, 2025 · 1 comment
Open

Up-to-date gold results #47

xxxbrem opened this issue Jan 18, 2025 · 1 comment

Comments

@xxxbrem
Copy link

xxxbrem commented Jan 18, 2025

Executed result of sf_001 gold SQL is different from gold result. Similar issues occurred for some other examples. I guess there are some changes in the database. Could you provide up-to-date gold results?

@lfy79001
Copy link
Collaborator

You're right, this is a dynamically changing database. Spider 2.0 includes a small number of dynamically changing databases. You can run the following query to get the most up-to-date gold answer: https://github.com/xlang-ai/Spider2/blob/main/spider2-snow/evaluation_suite/gold/sql/sf001.sql. This error may have occurred because we obtained the answer earlier. We have already updated the answers in the gold folder.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants