Generate Playwright tests from a sitemap with Mistral.ai

Try out: Python script for generating Playwright Tests from a sitemap with Mistral.ai

Automating Playwright Tests from a Sitemap with Mistral AI  

In this blog post, we’ll explore how to automate the generation of Playwright tests for web pages listed in a sitemap using the free Mistral API. This process involves fetching the sitemap, extracting URLs, and using Mistral AI to generate test scripts for each URL.

This is primarily a testing with the Mistral AI library for myself.

Script Overview  

Requirement: Get the Mistral API Key and create .env:

1

MISTRAL_API_KEY=your_actual_api_key

1
2

# Fetch sitemap from URL
sitemap_url = "https://d-oit.github.io/en/sitemap.xml"

The script uses the requests library to fetch the sitemap from the specified URL. For each URL, the script sends a prompt to Mistral AI to generate a Playwright test script.

As result the script returns the test code with markdown formatting. As an easy way we remove the markdown code formatting and have as result a .js file for using with Playwright.

• tests/generatePlaywrightTest.py

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38

import os
import requests
import xml.etree.ElementTree as ET
from mistralai import Mistral
from dotenv import load_dotenv

# Fetch sitemap from URL
sitemap_url = "https://d-oit.github.io/en/sitemap.xml"
response = requests.get(sitemap_url)
root = ET.fromstring(response.content)

# Extract URLs from sitemap
urls = [url.text for url in root.findall('.//{http://www.sitemaps.org/schemas/sitemap/0.9}loc')]

load_dotenv()

# Set up Mistral API
api_key = os.environ["MISTRAL_API_KEY"]
client = Mistral(api_key=api_key)

# Generate and save Playwright tests
for url in urls:
    prompt = f"Generate a production ready code to run it with Playwright test for all known use cases in JavaScript for the webpage at {url} .Only show me the code without any explanation, only the code. Thank you."
    response = client.chat.complete(model="mistral-large-latest", messages=[{"role": "user", "content": prompt}])
    test_code = response.choices[0].message.content
    
    test_code = test_code.replace("```javascript", "").replace("```", "")
    print("url: " + url)

    # Extract the last part of the URL as the filename
    urlName = url.replace("https://", "").replace('/', '_')
    # Create a sanitized filename from the URL
    filename = f"test_{urlName}.spec.js"
    
    with open(filename, 'w') as file:
        file.write(test_code)

print(f"Generated {len(urls)} test files.")

1

pip install requests python-dotenv mistralai lxml

• requests: for fetching the sitemap content over HTTP.
• python-dotenv: for loading environment variables from a .env file.
• mistralai: to interact with the Mistral API for generating code.
• lxml: provides the ET (ElementTree) API for parsing XML data (you can also use xml.etree.ElementTree if lxml is unavailable).

Generated Playwright .js file  

As a quick workaround for now we replace the markdown code formatting:

1
2
3
4
5
6
7

const { test, expect } = require('@playwright/test');

test.describe('Blog Page Tests', () => {
  test.beforeEach(async ({ page }) => {
    await page.goto('https://d-oit.github.io/en/blog/licenses-nuget-packages-net-core-solution/');
  });
...

Conclusion  

This script automates the generation of Playwright tests for web pages listed in a sitemap using Mistral AI.

By leveraging AI, you can quickly create comprehensive test scripts for your web applications, ensuring better coverage and reliability.

Most of the tests are not really useful. But it shows the possibility of creating automated tests.

Try out with the new Mistral.ai - Pixtral image creation