Fill down on AI field column

Baserow Help
1

Hi,

Is it possible to auto generate an entire column for an AI field? Without clicking generate on each row which is impossible for more than a handful of records. I can’t see how without coding an external script.

If not currently possible, will this be added in the future?

Thanks.

2

It is not possible currently, so that would be a feature request.

3

Here’s the issue to track the progress: Allow regenerating all AI field cell values at once (#2492) · Issues · Baserow / baserow · GitLab

4

sth that is not at all obvious is that you can select quite a few cells at once in an AI column and then right click and select “generate”.

It likely won’t work for the entire column but you should be able to generate for all cells visible on your screen (as long as the selection does not exceed the row select limit). If you select and then scroll - there are apparently some bugs and clicking generate does not work consistently.

5

Today I came across:

This is autofilling cells using AI on steroids.

6

Hey @dev-rd, currently you can select a maximum of 200 rows at once, which is also the limitation for the AI field.

I agree that it might not be obvious that you can generate values with AI for up to 200 rows simultaneously. We’ll discuss internally how we can improve the UI to make this feature more apparent.

7

the right-click alone is fine - maybe just add the info to AI field description on the website / in the documentation - as far as I know, there is no mention there of the right click menu for AI field.

one more question - for self-hosted version with increased row selection limits - I’m still unable to generate more fields at once - are there any other limits build into the AI field? I mean other than the:
BASEROW_ROW_PAGE_SIZE_LIMIT
BATCH_ROWS_SIZE_LIMIT

8

No, BATCH_ROWS_SIZE_LIMIT controls the amount of rows you can update in one batch run. By default it’s 200.

9

@dev-rd Just to be sure: do you see any specific errors that prevent you from using a different limit?

10

I’ve set both values to 1000+ but I’m still unable to “generate” more AI fields via the right-click menu than I have visible rows in my browser window, especially when I scroll down.

This seems a bit flaky overall, as in some cases, when I select more and I scroll back so I can see the top of the “selection”, Bserow lets me generate those AI fields, but it is nowhere close the set limit of 1000.

Other large selections work as expected (I am generally able to copy-paste and perform other operations on rows up to the new limit )

11

Could you show errors you get from Baserow API? Also, could you also show backend container messages?

12

No errors are reported to the user in the UI - the fields just do not generate anything.
I have not used the API to generate fields.

I’ll send you the log in a PM ( for when I first generated 3 AI answers, then selected more than a hundred rows - right clicked - the generate - there was no effect)

13

Could you verify with your OpenAI account if you’re not making requests above your plan’s threshold?

14

the same API key works fine with other tools and larger data sets.
Anyways, we’re way below the TPM and RPM limits and way below budget limits.

15

Thanks for the log. From what I see:

  • there’s one scheduled task to generate AI field values
[EXPORT_WORKER][2024-09-09 13:35:44] [2024-09-09 13:35:42,964: INFO/MainProcess] Task baserow_premium.fields.tasks.generate_ai_values_for_rows[91a30b90-a6f3-4404-bb58-141d36450037] received

It calls OpenAPI three times (as expected) and finishes after a few seconds:

[EXPORT_WORKER][2024-09-09 13:35:47] [2024-09-09 13:35:47,613: INFO/ForkPoolWorker-1] Task baserow_premium.fields.tasks.generate_ai_values_for_rows[91a30b90-a6f3-4404-bb58-141d36450037] succeeded in 4.647797350771725s: None

message.

  • there’s one log line from Baserow’s backend container with API that schedules generate_ai_values_for_rows task:
[BACKEND][2024-09-09 13:35:44] 172.17.0.1:0 - “POST /api/database/fields/24141/generate-ai-field-values/ HTTP/1.1” 202

The timestamp and the message was written after Celery received the task, so while the order is reversed, this is most likely the request that initialized the background task. The message from the backend was written after the code that schedules the task finished.

However, there’s no trace of any other request to the backend to schedule another batch of rows to regenerate with AI.

So, the problem may be on the frontend side. Could you check for errors/messages in the frontend by looking at JS console and network traffic in DevTools provided by the browser (press F12 to open DevTools panel/window)? Most likely there will be a message when you select rows, right-click and click on AI regeneration command.

16

I get this error:
TypeError: Cannot read properties of undefined (reading ‘map’)

this is the larger context (links edited out)

XXX.js:2 TypeError: Cannot read properties of undefined (reading ‘map’)
at YYY.js:1:0000000
at y (XXX.js:2:4392)
at Generator.< anonymous > (XXX.js:2:5729)
at Generator.next (XXX.js:2:4821)
at r (XXX.js:2:933)
at l (XXX.js:2:1136)
at XXX.js:2:1195
at new Promise ()
at XXX.js:2:1076
at f.generateAIFieldValues (YYY.js:1:0000000)

17

This seems like a bug in selection handling. Added an issue: multiple rows selection: AI field generation on right-click gets no rows in the frontend (#2979) · Issues · Baserow / baserow · GitLab