Loading…
Type: Tutorial clear filter
Wednesday, June 3
 

09:00 EEST

Ai-Powered E2E Mobile Testing With Appium And Mobile Mcp
Wednesday June 3, 2026 09:00 - 17:00 EEST
Writing mobile tests with Appium can be challenging. Many of us have dealt with unstable selectors, differences between Android and iOS, or slow progress. What if we could use artificial intelligence with Appium? And what exactly is Mobile MCP?

Tutorial Overview

This tutorial is for anyone interested in starting mobile testing with a modern approach. We’ll use Python throughout. Together, we will build an end-to-end framework where AI supports us from the beginning. We will see how tools like Mobile MCP can find elements without needing static IDs or XPath.

We’ll focus on building full end-to-end scenarios. We’ll test whether self-healing really works or is just hype. We’ll also look at where AI can speed up our work, and where we still need the Appium Inspector.

Prerequisites & Setup for Attendees:
Please complete the guideline beforehand: https://github.com/paciadawid/NTD2026_mobile_ai/blob/master/workshop-setup.md

Agenda
  1. AI in Appium: We’ll talk about the main challenges in classic mobile testing and what AI can help solve.
  2. E2E framework architecture: How to set up a project for AI-powered end-to-end testing, going beyond the basic Page Pattern.
  3. What is "Mobile MCP"? We’ll give a practical introduction to the tool and show how it works with Appium.
  4. AI vs. Appium Inspector: We’ll see how AI can find elements in an app as they change.
  5. Building an E2E Scenario: Step by step, we’ll create a full test path, like logging in, searching, and adding to the cart.
  6. Intelligent assertions and self-healing: We’ll see how AI helps check the app’s state and what it does when the UI changes.
  7. Results analysis: We’ll look at how AI can help us figure out why an end-to-end test failed.
  8. Summary: AI in mobile - revolution or evolution? We’ll finish with a Q&A session.


Speakers
avatar for Dawid Pacia

Dawid Pacia

QA Consultant, PathcingIT
QA and Test Automation Manager as well as mentor and trainer. Tech freak following all the newest technologies (and implementing them on his own). Fan of the Agile approach to project management and products. Supporting companies in transformations toward better quality. Actively... Read More →
Wednesday June 3, 2026 09:00 - 17:00 EEST
Puupakusaal Kultuurikatel

09:00 EEST

Beyond Assert(True): Hands-On Testing For LLMs And AI Agents
Wednesday June 3, 2026 09:00 - 17:00 EEST
Traditional software is deterministic: the same input yields the same output. Large Language Models (LLMs) and AI Agents have shattered this rule, introducing an inherently probabilistic paradigm. How do we ensure quality when the ground truth is shifting? This tutorial bridges the gap between traditional QA and AI evaluation. We will move beyond simple prompt testing into validating complex multi-agent systems. Participants will learn to build test oracles that evaluate intent and semantics rather than exact matches, evolving the QA role from a code verifier to an evaluation framework architect.

  • Target Audience: QA Engineers, SDETs, and Developers working with or transitioning to Generative AI systems.

  • Learning Objectives
    By the end of this workshop, participants will be able to:
    • Deconstruct AI Architectures: Identify specific testable layers such as Shell (API/UI), Orchestration (Context/Tools), and Inference Core (Probabilistic).
    • Build Modern Test Oracles: Implement aggregated and property-based oracles using Python to handle non-deterministic outputs.
    • Validate Multi-Agent Systems: Apply a four-level framework to test communication, delegation, and error propagation between AI agents.
    • Execute AI Red Teaming: Identify vulnerabilities such as prompt injection, hallucinations, and safety bypasses.
    • Automate Quality Metrics: Integrate BERTScore and RAG-specific metrics such as Faithfulness and Relevance into CI/CD pipelines.

    Prerequisites for Attendees:
    • Basic knowledge of Python and API fundamentals. Participants must bring a laptop with VS Code and Python installed. Alternatively, also Cursor, Claude Code, Codex, OpenCode, or any equivalent tool is suitable. In any case, make sure that the chosen agent is already installed, configured and ready for the session.

    Workshop Outline
    1. The Paradigm Shift
      • Theory: Deterministic vs. probabilistic testing. Agent taxonomy.
      • Practice: Environment setup and executing your first fuzzy test.
    2. Oracles & Orchestration
      • Theory: Atomic vs. aggregated oracles. Testing the orchestration layer.
      • Practice: Writing scripts to validate JSON schemas and output consistency.
    3. Semantic Evaluation
      • Theory: RAG metrics such as Faithfulness and Relevance. Introduction to BERTScore.
      • Practice: Building an LLM-as-a-Judge evaluator to grade complex answers.
    4. Multi-Agent Testing
      • Theory: Inter-agent communication and task delegation loops.
      • Practice: Debugging a workflow where a Travel Agent delegates to a Finance Agent.
    5. Red Teaming & Security
      • Theory: Prompt injection, mutation testing, and metamorphic testing.
      • Practice: Simulated attack scenarios, bypassing safety filters, and implementing guardrail fixes.
    6. QA Strategy & Governance
      • Theory: Human-in-the-loop workflows and production monitoring.
      • Practice: Designing a full-scale QA strategy for a real-world GenAI product.

    Speakers
    avatar for Tiago Gomes

    Tiago Gomes

    Lead QA Consultant, Thoughtworks
    Tiago Gomes is a passionate technology leader and Lead Consultant at Thoughtworks, dedicated to advancing the industry through hands-on project work and mentorship.  With expertise in Software Testing and Project Management, he collaborates with clients to understand their challenges... Read More →
    avatar for Daniel Carvalho

    Daniel Carvalho

    Senior QA Engineer, Hostfully
    Daniel Carvalho is a Senior QA Engineer focused on building scalable, data driven quality systems through automation and modern testing strategies. He specializes in Risk Based Testing, Critical Flow Testing, API testing, and quality metrics that enable faster, better informed decisions... Read More →
    Wednesday June 3, 2026 09:00 - 17:00 EEST
    Terrassi Kultuurikatel

    09:00 EEST

    How to Lead Testing at the Organizational Level?
    Wednesday June 3, 2026 09:00 - 17:00 EEST
    Test leadership is required at organizational and operational levels in many organizations. In this tutorial, we explain the fundamentals of test leadership and have practical exercises to understand it. We discuss what leadership means in different scenarios, where effective test leadership is needed, and where leadership is all too often missing.

    Testing leadership is always needed, even if testing or development is subcontracted. Especially in larger organizations, organizational leadership is needed for testing, for example, to set the vision, harmonize testing across teams, increase productivity, align testing activities, and support different management levels and teams involved in testing.

    The tutorial utilizes the ACT2LEAD heuristic about software testing leadership. To understand it properly, the audience is divided into teams with a brief exercise for each part of the heuristic. The ACT2LEAD heuristic consists of eight core practices of testing leadership.

    We’ll go through eight principles in practice:
    • ACT - how to add testing into all software development actions
    • CONTEXT - how to choose the right testing based on context
    • TRANSPARENCY - how to create visibility for the quality of testing practices and test results
    • 2 - how to strike the perfect balance between automated testing and human-driven exploration
    • LEARN - learning as a way to improve
    • ENABLE - enabling a culture of quality and continuous improvement
    • ADAPT - aligning testing efforts with product risks
    • DIVERSE - implementing diverse testing approaches for finding diverse sets of defects and observations
    The tutorial uses most of its time on several exercises set in the context of a large, imaginary corporation case study. In teams, participants create software testing leadership artefacts for the case study organization. The exercises are designed for the organizational level, but they also fit the team level.

    The tutorial is ideal for roles like Head of Testing, QA Lead, and Test Manager. It is also good for anyone who wants to develop their competencies toward test leadership.

    Each participant is encouraged to bring a laptop, though one per four people is sufficient. Internet access is needed, too.

    Each participant gets an ACT 2 LEAD Software Testing Leadership Handbook as an e-book, which they can use to study this topic further.

    Prerequisites for Attending the Tutorial:
    Please bring a laptop if possible (group/pair work is also supported). During the session, you'll get free access to the ACT2LEAD Software Testing Leadership Handbook e-book, which we will use for hands-on exercises.

    A high-level outline of the tutorial
    • What is testing leadership
    • ACT2LEAD heuristic for testing leadership, including a brief exercise
    • Organizational and operational levels of testing leadership
    • Short introduction to leading people and change
    • Exercise: Stakeholder mapping
    • Exercise: Create an organizational-level testing policy (principles)
    • Exercise: Create an organizational-level strategy (guidelines)
    • Exercise: Extended retrospective for visibility and continuous improvement
    • Exercise: Testing in contracts
    • Exercise: Competence development
    • Optional Exercises, e.g., on Shift Left, Recruiting, Visibility, People, OKR

    Speakers
    avatar for Kari Kakkonen

    Kari Kakkonen

    Author and CEO, Dragons Out
    Mr. Kari Kakkonen has worked in software testing for almost 30 years. He is the co-author of ‘ACT 2 LEAD Software Testing Leadership Handbook’ and co-winner of the ICT Influencer of the Year 2025 in Finland.

    Kari is the 2021 EuroSTAR Testing Excellence Award winner, the Tester of the Year in Finland Award 2021 winner, and the DASA Exemplary DevOps Instructor Award 2023 winner. He is the author and CEO of Dragons Out Oy, which created a fantasy book to teach children software testing... Read More →
    avatar for Marko Rytkönen

    Marko Rytkönen

    Quality Coach, Hidden Trail
    Over the past three decades, Marko has held various roles in the world of software testing - from testing, test management, and leading testing at an organizational level to leading a global testing consultancy business. He has worked in global product companies with known brands... Read More →
    Wednesday June 3, 2026 09:00 - 17:00 EEST
    D-Saal Kultuurikatel
      Tutorial

    09:00 EEST

    MCP Playwright & Playwright Agents Workshop
    Wednesday June 3, 2026 09:00 - 17:00 EEST
    This full-day, hands-on tutorial dives into test automation using the Model Context Protocol (MCP) and AI agents. Participants will first master the MCP architecture, the standardized foundation for AI-driven applications.

    The core of the tutorial focuses on Playwright's AI Agents (Planner, Generator, Healer). You will learn to leverage these agents to:
    • Intelligently discover and map application test surfaces (Planner).
    • Automatically generate executable Playwright code from natural language specifications (Generator).
    • Implement self-healing mechanisms to automatically detect and repair broken tests after UI changes (Healer).
    The session covers integration techniques, including connecting MCP with GitHub Copilot for an issue-to-implementation workflow, and best practices for production-ready, CI/CD-integrated test suites.

    Prerequisites:
    • Basic understanding of JavaScript/TypeScript
    • Familiarity with web testing concepts
    • Node.js 18+ installed
    • VS Code or similar IDE

    Tutorial Objectives:
    By the end of this tutorial, participants will be able to:
    1. Understand the Model Context Protocol (MCP) architecture and its role in AI-driven automation
    2. Set up and configure MCP Playwright servers in multiple environments
    3. Leverage AI agents (Planner, Generator, Healer) for test automation
    4. Build intelligent, self-healing test automation frameworks
    5. Integrate MCP with GitHub Copilot and other AI tools
    6. Implement best practices for production-ready test automation

    Tutorial Agenda
    Morning Session (9:00 AM - 12:30 PM)
    • 9:00 - 9:30 AM: Welcome & Tutorial Introduction
      • Participant introductions and icebreaker
      • Tutorial objectives and expected outcomes
      • Overview of the day's schedule
      • Environment setup verification
    • 9:30 - 10:45 AM: Module 1 - Understanding MCP (Model Context Protocol)
      • What is MCP and why it matters
      • The evolution from custom integrations to standardized protocols
      • MCP as the "USB-C for AI applications"
      • MCP Architecture deep dive
        • Client-Server architecture
        • MCP Host, Client, and Server relationships
        • Data layer: JSON-RPC 2.0 protocol
        • Transport layer: stdio, SSE, WebSockets
      • MCP vs traditional approaches (ChatGPT plugins, custom APIs)
      • Real-world use cases and success stories
      • Hands-on Exercise 1:
        • Setting up your first MCP server
        • Configuring Claude Desktop/VS Code with MCP
        • Testing basic MCP connectivity
      • Resources Provided:
        • MCP architecture diagrams
        • Configuration templates
        • Troubleshooting guide
    • 10:45 - 11:00 AM: Coffee Break
    • 11:00 AM - 12:30 PM: Module 2 - Playwright MCP Fundamentals
      • Introduction to Playwright MCP Server
      • Microsoft's official implementation vs community alternatives
      • Key features: accessibility tree usage, deterministic actions
      • Supported capabilities: vision, PDF handling
      • MCP Server architecture for Playwright
      • Browser automation via MCP protocol
      • Tools, Resources, and Prompts in MCP context
      • Storage modes: persistent vs isolated profiles
      • Demo Session:
        • Installing Playwright MCP: npx @playwright/mcp@latest
        • Configuration options and arguments
        • Connecting MCP to different clients (Claude Desktop, VS Code, Cursor)
        • Live demonstration of browser automation via MCP
      • Hands-on Exercise 2:
        • Configure Playwright MCP in your development environment
        • Create your first AI-driven browser automation
        • Use natural language prompts to navigate and interact with a demo website
        • Capture and analyze accessibility snapshots
        • Challenge: Automate a simple e-commerce flow (browse → add to cart → checkout) using only natural language prompts through MCP.
    Lunch Break (12:30 - 1:30 PM)
    Afternoon Session (1:30 PM - 5:00 PM)
    • 1:30 - 3:00 PM: Module 3 - Playwright AI Agents
      • Introduction to Playwright Test Agents
      • The three agents: Planner, Generator, Healer
      • Agent workflows and lifecycle
      • Planner Agent: Intelligent test discovery
        • How it explores applications
        • Generating comprehensive test plans
      • Generator Agent: Automated test creation
        • Converting test plans to Playwright code
        • Natural language to code translation
      • Healer Agent: Self-healing tests
        • Detecting and fixing broken tests
        • Automatic locator updates
        • Handling UI changes
      • Demo Session:
        • Setting up Playwright Agents: npx @playwright/test init-agents
        • Live demo: Planner agent exploring a web application
        • Live demo: Generator creating tests from specifications
        • Live demo: Healer fixing failing tests after UI changes
      • Hands-on Exercise 3:
        • Initialize agents in your project
        • Use Planner agent to explore a sample application
        • Generate test specs in Markdown format
        • Convert specs to executable Playwright tests with Generator
        • Introduce breaking changes and use Healer to repair tests
      • Group Activity: Teams work on different sections of an e-commerce application, comparing agent-generated tests vs manually written tests.
    • 3:00 - 3:15 PM: Coffee Break
    • 3:15 - 5:00 PM: Module 4 - Advanced Integration & Best Practices
      • Integrating MCP with GitHub Copilot Coding Agent
        • How Copilot uses Playwright MCP
        • Verifying code changes in real browsers
        • Issue-to-implementation workflow
      • Advanced MCP features
        • Custom MCP servers for specific needs
        • Multi-tool workflows (MCP + web search + internal tools)
        • Security considerations and sandboxing
      • Best practices for production deployments
        • Test organization and structure
        • Page Object Model with AI-generated tests
        • CI
    Speakers
    avatar for Srinivasan Sekar

    Srinivasan Sekar

    Director of Engineering, Lambdatest
    Srinivasan Sekar is a Director of Engineering at LambdaTest. He loves contributing to Open Source. He is an Appium Member and Contributor to various open-source repositories like Selenium, Webdriver.io, taiko, etc. He worked extensively on testing various Microservices, EvenDriven... Read More →
    avatar for Sai Krishna

    Sai Krishna

    Director of Engineering, TestMu AI
    I am a Director of Engineering at LambdaTest with a decade of experience in testing mobile applications and building automation frameworks. As an active contributor to Appium and a member of the Appium organization, I am deeply involved in the open-source community. I am passionate... Read More →
    Wednesday June 3, 2026 09:00 - 17:00 EEST
    Stalker Kultuurikatel
      Tutorial
     
    Share Modal

    Share this link via

    Or copy link

    Filter sessions
    Apply filters to sessions.