Loading…
Type: Tutorial clear filter
Wednesday, June 3
 

09:00 EEST

Ai-Powered E2E Mobile Testing With Appium And Mobile Mcp
Wednesday June 3, 2026 09:00 - 17:00 EEST
Writing mobile tests with Appium can be challenging. Many of us have dealt with unstable selectors, differences between Android and iOS, or slow progress. What if we could use artificial intelligence with Appium? And what exactly is Mobile MCP?

Tutorial Overview

This tutorial is for anyone interested in starting mobile testing with a modern approach. We’ll use Python throughout. Together, we will build an end-to-end framework where AI supports us from the beginning. We will see how tools like Mobile MCP can find elements without needing static IDs or XPath.

We’ll focus on building full end-to-end scenarios. We’ll test whether self-healing really works or is just hype. We’ll also look at where AI can speed up our work, and where we still need the Appium Inspector.

Note: This is a hands-on tutorial and requires some preparation upfront. We’ll send you detailed instructions in advance.


Agenda
  1. AI in Appium: We’ll talk about the main challenges in classic mobile testing and what AI can help solve.
  2. E2E framework architecture: How to set up a project for AI-powered end-to-end testing, going beyond the basic Page Pattern.
  3. What is "Mobile MCP"? We’ll give a practical introduction to the tool and show how it works with Appium.
  4. AI vs. Appium Inspector: We’ll see how AI can find elements in an app as they change.
  5. Building an E2E Scenario: Step by step, we’ll create a full test path, like logging in, searching, and adding to the cart.
  6. Intelligent assertions and self-healing: We’ll see how AI helps check the app’s state and what it does when the UI changes.
  7. Results analysis: We’ll look at how AI can help us figure out why an end-to-end test failed.
  8. Summary: AI in mobile - revolution or evolution? We’ll finish with a Q&A session.


Speakers
avatar for Dawid Pacia

Dawid Pacia

QA Consultant, PathcingIT
QA and Test Automation Manager as well as mentor and trainer. Tech freak following all the newest technologies (and implementing them on his own). Fan of the Agile approach to project management and products. Supporting companies in transformations toward better quality. Actively... Read More →
Wednesday June 3, 2026 09:00 - 17:00 EEST
Puupakusaal Kultuurikatel

09:00 EEST

Beyond Assert(True): Hands-On Testing For LLMs And AI Agents
Wednesday June 3, 2026 09:00 - 17:00 EEST
Traditional software is deterministic: the same input yields the same output. Large Language Models (LLMs) and AI Agents have shattered this rule, introducing an inherently probabilistic paradigm. How do we ensure quality when the ground truth is shifting? This tutorial bridges the gap between traditional QA and AI evaluation. We will move beyond simple prompt testing into validating complex multi-agent systems. Participants will learn to build test oracles that evaluate intent and semantics rather than exact matches, evolving the QA role from a code verifier to an evaluation framework architect.

Learning Objectives
By the end of this workshop, participants will be able to:
  • Deconstruct AI Architectures: Identify specific testable layers such as Shell (API/UI), Orchestration (Context/Tools), and Inference Core (Probabilistic).
  • Build Modern Test Oracles: Implement aggregated and property-based oracles using Python to handle non-deterministic outputs.
  • Validate Multi-Agent Systems: Apply a four-level framework to test communication, delegation, and error propagation between AI agents.
  • Execute AI Red Teaming: Identify vulnerabilities such as prompt injection, hallucinations, and safety bypasses.
  • Automate Quality Metrics: Integrate BERTScore and RAG-specific metrics such as Faithfulness and Relevance into CI/CD pipelines.
Target Audience & Prerequisites
  • Target Audience: QA Engineers, SDETs, and Developers working with or transitioning to Generative AI systems.
  • Prerequisites: Basic knowledge of Python and API fundamentals. Participants must bring a laptop with VS Code and Python installed.

Workshop Outline
  1. The Paradigm Shift
    • Theory: Deterministic vs. probabilistic testing. Agent taxonomy.
    • Practice: Environment setup and executing your first fuzzy test.
  2. Oracles & Orchestration
    • Theory: Atomic vs. aggregated oracles. Testing the orchestration layer.
    • Practice: Writing scripts to validate JSON schemas and output consistency.
  3. Semantic Evaluation
    • Theory: RAG metrics such as Faithfulness and Relevance. Introduction to BERTScore.
    • Practice: Building an LLM-as-a-Judge evaluator to grade complex answers.
  4. Multi-Agent Testing
    • Theory: Inter-agent communication and task delegation loops.
    • Practice: Debugging a workflow where a Travel Agent delegates to a Finance Agent.
  5. Red Teaming & Security
    • Theory: Prompt injection, mutation testing, and metamorphic testing.
    • Practice: Simulated attack scenarios, bypassing safety filters, and implementing guardrail fixes.
  6. QA Strategy & Governance
    • Theory: Human-in-the-loop workflows and production monitoring.
    • Practice: Designing a full-scale QA strategy for a real-world GenAI product.

Speakers
avatar for Tiago Gomes

Tiago Gomes

Lead QA Consultant, Thoughtworks
Tiago Gomes is a passionate technology leader and Lead Consultant at Thoughtworks, dedicated to advancing the industry through hands-on project work and mentorship.  With expertise in Software Testing and Project Management, he collaborates with clients to understand their challenges... Read More →
avatar for Daniel Carvalho

Daniel Carvalho

Senior QA Engineer, Hostfully
Daniel Carvalho is a Senior QA Engineer focused on building scalable, data driven quality systems through automation and modern testing strategies. He specializes in Risk Based Testing, Critical Flow Testing, API testing, and quality metrics that enable faster, better informed decisions... Read More →
Wednesday June 3, 2026 09:00 - 17:00 EEST
TBD Kultuurikatel

09:00 EEST

How to Lead Testing at the Organizational Level?
Wednesday June 3, 2026 09:00 - 17:00 EEST
Test leadership is required at organizational and operational levels in many organizations. In this tutorial, we explain the fundamentals of test leadership and have practical exercises to understand it. We discuss what leadership means in different scenarios, where effective test leadership is needed, and where leadership is all too often missing.
Testing leadership is always needed, even if testing or development is subcontracted. Especially in larger organizations, organizational leadership is needed for testing, for example, to set the vision, harmonize testing across teams, increase productivity, align testing activities, and support different management levels and teams involved in testing.

The tutorial utilizes the ACT2LEAD heuristic about software testing leadership. To understand it properly, the audience is divided into teams with a brief exercise for each part of the heuristic. The ACT2LEAD heuristic consists of eight core practices of testing leadership.

We’ll go through eight principles in practice:
  • ACT - how to add testing into all software development actions
  • CONTEXT - how to choose the right testing based on context
  • TRANSPARENCY - how to create visibility for the quality of testing practices and test results
  • 2 - how to strike the perfect balance between automated testing and human-driven exploration
  • LEARN - learning as a way to improve
  • ENABLE - enabling a culture of quality and continuous improvement
  • ADAPT - aligning testing efforts with product risks
  • DIVERSE - implementing diverse testing approaches for finding diverse sets of defects and observations
The tutorial uses most of its time on several exercises set in the context of a large, imaginary corporation case study. In teams, participants create software testing leadership artefacts for the case study organization. The exercises are designed for the organizational level, but they also fit the team level.

The tutorial is ideal for roles like Head of Testing, QA Lead, and Test Manager. It is also good for anyone who wants to develop their competencies toward test leadership.

Each participant is encouraged to bring a laptop, though one per four people is sufficient. Internet access is needed, too.

Each participant gets an ACT 2 LEAD Software Testing Leadership Handbook as an e-book, which they can use to study this topic further.

A high-level outline of the tutorial
  • What is testing leadership
  • ACT2LEAD heuristic for testing leadership, including a brief exercise
  • Organizational and operational levels of testing leadership
  • Short introduction to leading people and change
  • Exercise: Stakeholder mapping
  • Exercise: Create an organizational-level testing policy (principles)
  • Exercise: Create an organizational-level strategy (guidelines)
  • Exercise: Extended retrospective for visibility and continuous improvement
  • Exercise: Testing in contracts
  • Exercise: Competence development
  • Optional Exercises, e.g., on Shift Left, Recruiting, Visibility, People, OKR

Speakers
avatar for Kari Kakkonen

Kari Kakkonen

Author and CEO, Dragons Out
Mr. Kari Kakkonen has worked in software testing for almost 30 years. He is the co-author of ‘ACT 2 LEAD Software Testing Leadership Handbook’ and co-winner of the ICT Influencer of the Year 2025 in Finland.
Kari is the 2021 EuroSTAR Testing Excellence Award winner, the Tester of the Year in Finland Award 2021 winner, and the DASA Exemplary DevOps Instructor Award 2023 winner. He is the author and CEO of Dragons Out Oy, which created a fantasy book to teach children software testing... Read More →
avatar for Marko Rytkönen

Marko Rytkönen

Quality Coach, Hidden Trail
Over the past three decades, Marko has held various roles in the world of software testing - from testing, test management, and leading testing at an organizational level to leading a global testing consultancy business. He has worked in global product companies with known brands... Read More →
Wednesday June 3, 2026 09:00 - 17:00 EEST
D-Saal Kultuurikatel
  Tutorial

09:00 EEST

MCP Playwright & Playwright Agents Workshop
Wednesday June 3, 2026 09:00 - 17:00 EEST
This full-day, hands-on tutorial dives into test automation using the Model Context Protocol (MCP) and AI agents. Participants will first master the MCP architecture, the standardized foundation for AI-driven applications.

The core of the tutorial focuses on Playwright's AI Agents (Planner, Generator, Healer). You will learn to leverage these agents to:
  • Intelligently discover and map application test surfaces (Planner).
  • Automatically generate executable Playwright code from natural language specifications (Generator).
  • Implement self-healing mechanisms to automatically detect and repair broken tests after UI changes (Healer).
The session covers integration techniques, including connecting MCP with GitHub Copilot for an issue-to-implementation workflow, and best practices for production-ready, CI/CD-integrated test suites.

Prerequisites:
  • Basic understanding of JavaScript/TypeScript
  • Familiarity with web testing concepts
  • Node.js 18+ installed
  • VS Code or similar IDE

Tutorial Objectives:
By the end of this tutorial, participants will be able to:
  1. Understand the Model Context Protocol (MCP) architecture and its role in AI-driven automation
  2. Set up and configure MCP Playwright servers in multiple environments
  3. Leverage AI agents (Planner, Generator, Healer) for test automation
  4. Build intelligent, self-healing test automation frameworks
  5. Integrate MCP with GitHub Copilot and other AI tools
  6. Implement best practices for production-ready test automation
Tutorial Agenda
Morning Session (9:00 AM - 12:30 PM)
  • 9:00 - 9:30 AM: Welcome & Tutorial Introduction
    • Participant introductions and icebreaker
    • Tutorial objectives and expected outcomes
    • Overview of the day's schedule
    • Environment setup verification
  • 9:30 - 10:45 AM: Module 1 - Understanding MCP (Model Context Protocol)
    • What is MCP and why it matters
    • The evolution from custom integrations to standardized protocols
    • MCP as the "USB-C for AI applications"
    • MCP Architecture deep dive
      • Client-Server architecture
      • MCP Host, Client, and Server relationships
      • Data layer: JSON-RPC 2.0 protocol
      • Transport layer: stdio, SSE, WebSockets
    • MCP vs traditional approaches (ChatGPT plugins, custom APIs)
    • Real-world use cases and success stories
    • Hands-on Exercise 1:
      • Setting up your first MCP server
      • Configuring Claude Desktop/VS Code with MCP
      • Testing basic MCP connectivity
    • Resources Provided:
      • MCP architecture diagrams
      • Configuration templates
      • Troubleshooting guide
  • 10:45 - 11:00 AM: Coffee Break
  • 11:00 AM - 12:30 PM: Module 2 - Playwright MCP Fundamentals
    • Introduction to Playwright MCP Server
    • Microsoft's official implementation vs community alternatives
    • Key features: accessibility tree usage, deterministic actions
    • Supported capabilities: vision, PDF handling
    • MCP Server architecture for Playwright
    • Browser automation via MCP protocol
    • Tools, Resources, and Prompts in MCP context
    • Storage modes: persistent vs isolated profiles
    • Demo Session:
      • Installing Playwright MCP: npx @playwright/mcp@latest
      • Configuration options and arguments
      • Connecting MCP to different clients (Claude Desktop, VS Code, Cursor)
      • Live demonstration of browser automation via MCP
    • Hands-on Exercise 2:
      • Configure Playwright MCP in your development environment
      • Create your first AI-driven browser automation
      • Use natural language prompts to navigate and interact with a demo website
      • Capture and analyze accessibility snapshots
      • Challenge: Automate a simple e-commerce flow (browse → add to cart → checkout) using only natural language prompts through MCP.
Lunch Break (12:30 - 1:30 PM)
Afternoon Session (1:30 PM - 5:00 PM)
  • 1:30 - 3:00 PM: Module 3 - Playwright AI Agents
    • Introduction to Playwright Test Agents
    • The three agents: Planner, Generator, Healer
    • Agent workflows and lifecycle
    • Planner Agent: Intelligent test discovery
      • How it explores applications
      • Generating comprehensive test plans
    • Generator Agent: Automated test creation
      • Converting test plans to Playwright code
      • Natural language to code translation
    • Healer Agent: Self-healing tests
      • Detecting and fixing broken tests
      • Automatic locator updates
      • Handling UI changes
    • Demo Session:
      • Setting up Playwright Agents: npx @playwright/test init-agents
      • Live demo: Planner agent exploring a web application
      • Live demo: Generator creating tests from specifications
      • Live demo: Healer fixing failing tests after UI changes
    • Hands-on Exercise 3:
      • Initialize agents in your project
      • Use Planner agent to explore a sample application
      • Generate test specs in Markdown format
      • Convert specs to executable Playwright tests with Generator
      • Introduce breaking changes and use Healer to repair tests
    • Group Activity: Teams work on different sections of an e-commerce application, comparing agent-generated tests vs manually written tests.
  • 3:00 - 3:15 PM: Coffee Break
  • 3:15 - 5:00 PM: Module 4 - Advanced Integration & Best Practices
    • Integrating MCP with GitHub Copilot Coding Agent
      • How Copilot uses Playwright MCP
      • Verifying code changes in real browsers
      • Issue-to-implementation workflow
    • Advanced MCP features
      • Custom MCP servers for specific needs
      • Multi-tool workflows (MCP + web search + internal tools)
      • Security considerations and sandboxing
    • Best practices for production deployments
      • Test organization and structure
      • Page Object Model with AI-generated tests
      • CI/CD integration (GitHub Actions, Docker)
      • Test data management and fixtures
      • Handling flaky tests with AI assistance
Speakers
avatar for Srinivasan Sekar

Srinivasan Sekar

Director of Engineering, Lambdatest
Srini.codes
avatar for Sai Krishna

Sai Krishna

Director of Engineering, TestMu AI
I am a Director of Engineering at LambdaTest with a decade of experience in testing mobile applications and building automation frameworks. As an active contributor to Appium and a member of the Appium organization, I am deeply involved in the open-source community. I am passionate... Read More →
Wednesday June 3, 2026 09:00 - 17:00 EEST
Stalker Kultuurikatel
  Tutorial
 
Share Modal

Share this link via

Or copy link

Filter sessions
Apply filters to sessions.