Loading...

XML

Word

Printable

Type: Improvement
Resolution: Fixed
Priority: Minor
Fix Version/s: 5.0
Affects Version/s: Future Dev
Component/s: AI
Labels:

Fixed Branches:
MOODLE_500_STABLE
Epic Link:
AI - Phase 2
Pull from Repository:
https://github.com/davewoloszyn/moodle.git
Pull Main Branch:
~~MDL-83394~~-main
Pull Main Diff URL:
https://github.com/davewoloszyn/moodle/compare/536d9ff4ee...MDL-83394-main
Testing Instructions:
Hide

Setup

Log in as admin

Go to Site admin -> General -> AI -> Manage settings for AI Providers

Setup the OpenAI provider (reach out if you need assistance).

Ensure that OpenAI has the 'Generate image' action enabled.

Go to Site admin -> General -> AI -> Manage settings for AI placements

Ensure 'HTML Text Editor Placement' placement is enabled.

Testing scenario

Log in as a user.

Go to your 'Edit profile' page.

In the Tiny editor, click the generate image button from the AI actions menu.

In the prompt text area, type in something simple like 'mountain landscape'.

Click the 'Generate image' button.

After generation, click the 'Next' button.

CONFIRM that the text that appears in the text box is not your original prompt, but a more descriptive version of it (this is the revised prompt that the AI model used).
Show
Setup Log in as admin Go to Site admin -> General -> AI -> Manage settings for AI Providers Setup the OpenAI provider (reach out if you need assistance). Ensure that OpenAI has the 'Generate image' action enabled. Go to Site admin -> General -> AI -> Manage settings for AI placements Ensure 'HTML Text Editor Placement' placement is enabled. Testing scenario Log in as a user. Go to your 'Edit profile' page. In the Tiny editor, click the generate image button from the AI actions menu. In the prompt text area, type in something simple like 'mountain landscape'. Click the 'Generate image' button. After generation, click the 'Next' button. CONFIRM that the text that appears in the text box is not your original prompt, but a more descriptive version of it (this is the revised prompt that the AI model used).
Pre-check results:
Hide

Code verified against automated checks with warnings.

Checked ~~MDL-83394~~ using repository: https://github.com/davewoloszyn/moodle.git

main (0 errors / 1 warnings) [branch: MDL-83394-main | CI Job]

overview (0/1), phplint (0/0), phpcs (0/0), js (0/0), css (0/0), phpdoc (0/0), commit (0/0), savepoint (0/0), thirdparty (0/0), externalbackup (0/0), grunt (0/0), shifter (0/0), mustache (0/0), gherkin (0/0),

Warn: the branch is based off integration.git

Should these errors be fixed?

Built on: Wed 06 Nov 2024 03:30:16 AM UTC
Show
Code verified against automated checks with warnings. Checked MDL-83394 using repository: https://github.com/davewoloszyn/moodle.git main (0 errors / 1 warnings) [branch: MDL-83394-main | CI Job ] overview (0/1) , phplint (0/0) , phpcs (0/0) , js (0/0) , css (0/0) , phpdoc (0/0) , commit (0/0) , savepoint (0/0) , thirdparty (0/0) , externalbackup (0/0) , grunt (0/0) , shifter (0/0) , mustache (0/0) , gherkin (0/0) , Warn: the branch is based off integration.git Should these errors be fixed? Built on: Wed 06 Nov 2024 03:30:16 AM UTC
Automated test results:
Hide

Launching automatic jobs for branch ~~MDL-83394~~-main

https://ci.moodle.org/view/Testing/job/DEV.02%20-%20Developer-requested%20PHPUnit/17016/ PHPUnit (sqlsrv)

https://ci.moodle.org/view/Testing/job/DEV.01%20-%20Developer-requested%20Behat/57962/ Behat (NonJS - boost and classic)

https://ci.moodle.org/view/Testing/job/DEV.01%20-%20Developer-requested%20Behat/57963/ Behat (Firefox - boost)

https://ci.moodle.org/view/Testing/job/DEV.01%20-%20Developer-requested%20Behat/57964/ Behat (Firefox - classic)

https://ci.moodle.org/view/Testing/job/DEV.01%20-%20Developer-requested%20Behat/57965/ App tests (stable app version)

Built on: Wed Oct 16 12:25:28 PM UTC 2024
Show
Launching automatic jobs for branch MDL-83394 -main https://ci.moodle.org/view/Testing/job/DEV.02%20-%20Developer-requested%20PHPUnit/17016/ PHPUnit (sqlsrv) https://ci.moodle.org/view/Testing/job/DEV.01%20-%20Developer-requested%20Behat/57962/ Behat (NonJS - boost and classic) https://ci.moodle.org/view/Testing/job/DEV.01%20-%20Developer-requested%20Behat/57963/ Behat (Firefox - boost) https://ci.moodle.org/view/Testing/job/DEV.01%20-%20Developer-requested%20Behat/57964/ Behat (Firefox - classic) https://ci.moodle.org/view/Testing/job/DEV.01%20-%20Developer-requested%20Behat/57965/ App tests (stable app version) Built on: Wed Oct 16 12:25:28 PM UTC 2024

Story Points:
2
Sprint:
Team Hedgehog 2024 Review 4, Team Hedgehog 2024 Sprint 4.1

Currently when a user generates an image from a text description the users description is used by default as the images alt text.

However, most AI providers adapt and expand on this description before passing it to their image generation images. Also most providers return this extended prompt with the image response. This extended prompt generally provides a much more detailed description of the image that has been generated.

We should use this extended prompt for the alt text. And fall back to the user prompt when the extended prompt is not available.

- - Sort By Name
  - Sort By Date
  - Ascending
  - Descending
  - Thumbnails
  - List
  - Download All

(1) 7 Passed -- (Main)MDL-83394.png
297 kB
06/Nov/24 2:53 PM
MDL-83394_Step5.png
358 kB
16/Oct/24 7:44 PM
MDL-83394_Step7.png
295 kB
16/Oct/24 7:44 PM

is blocked by

MDL-78453 Allow users to enter a long description for complex images

Closed

Assignee:: David Woloszyn

Reporter:: Matt Porritt

Peer reviewer:: Raquel Ortega

Integrator:: Jun Pataleta

Tester:: Kim Jared Lucas

Participants:: CiBoT, David Woloszyn, Jun Pataleta, Kim Jared Lucas, Matt Porritt, Raquel Ortega

Votes:: 0 Vote for this issue

Watchers:: 6 Start watching this issue

Created:: 09/Oct/24 5:17 AM

Updated:: 08/Nov/24 3:56 PM

Resolved:: 08/Nov/24 3:56 PM

Estimated:

Not Specified

Remaining:

Logged:

2h 54m

Details

Setup

Testing scenario

Description

Attachments

Attachments

Issue Links

Activity

People

Dates

Time Tracking

Clockify