Modern Dev/Test/Live Workflows 

Automate CI/CD & Deployments 

Bring Your Own Cloud (BYOC) 

Built for Serious Agencies 

Drupal CMS AI Agents Testing Framework

Test Framework.

This is a template to try out and launch the tests of the Agents in Drupal CMS. This will allow you to create more tests and groups of tests and run them. Fantastic for trying out different providers and models to see how well they run Drupal CMS.

A Video can be found here:


The template is built from here: https://github.com/drupalforge/drupal_cms_ai_agents_test_framework

You can download the module and get started locally instead here: https://www.drupal.org/project/ai_agents_test 

Getting Started

  • You will likely need more credits than Drupalforge gives for free. So you can go to Configuration -> AI -> AI Providers and add your own anthropic or OpenAI key.
  • To get back to the Tests go to Content in the navigation and select "Agent Tests" as one of the tabs.
  • Then go to the sub-tab "Test Groups" This is the best place to run the tests.
  • Select a Group, click the little arrow on the most right bit of the screen and select Run test groups.
  • You can also see the results or go into details of the tests to see all the steps.
  • Note: These tests actually run on the drupal site, if the tests as for content to be created, actual content is created on the site (so the next test in the group can rely on that content existing). Therefore they can't easily be re-run unless you delete everything and start again.
  • Tests and Test groups can be exported and imported, they are YAML files. We don't have a good way of storing those tests for other modules yet (Do you put it in the module itself, make a new module just for testing? Put them all in the above module?)
     

Our Goal is to make it so that these tests can also run in a CI/CD environment and test the latest version of Drupal CMS. You could also have a go creating your own tests entirely through the UI and add a test group. Or adding content types and modules and running tests on those.

We hope to make it easy to submit tests but you could try by adding things to the github repo above.

Happy testing!

Frequently Asked Questions

What is ShopForge?
Drupal forge

ShopForge is the developer and cloud operations platform for Shopware 6. Powered by DevPanel's orchestration engine, it provides a unified layer to manage your entire software development lifecycle (SDLC)—from browser-based Cloud IDEs to automated CI/CD pipelines. 
Is ShopForge a hosting provider?
How does the "Bring Your Own Cloud" (BYOC) model work?
Can agencies manage multiple clients on the platform?
How do live updates and releases work?
Can agencies or freelancers use ShopForge for clients?
Do I need to install anything?
How do I try the Beta go-live feature?
Can I share my demo or dev site with others?
How long do demo and dev environments last?
Can I download my site for offline use?
Can I contribute to ShopForge?
Scroll