notebooks/agents/Parallelization Workflow.ipynb

{
 "cells": [
  {
   "metadata": {},
   "cell_type": "markdown",
   "source": [
    "# Parallelization Workflow\n",
    "\n",
    "In this notebook, we'll explore parallelization as a powerful workflow pattern for building AI agents.\n",
    "Using Kotlin's coroutines and Claude via LangChain4j,\n",
    "we'll implement examples showing how to run LLM tasks concurrently for improved performance and reliability.\n",
    "\n",
    "## What is parallelization?\n",
    "\n",
    "Parallelization involves running multiple LLM tasks simultaneously and then combining their results.\n",
    "This approach offers two main variations:\n",
    "\n",
    "![Parallelization Workflow Diagram](image/parallelization.svg)\n",
    "\n",
    "### When to use parallelization\n",
    "- Sectioning — Breaking a complex task into independent subtasks that can be processed in parallel.\n",
    "  Each LLM instance focuses on a specific aspect of the problem, allowing for more focused attention and often better results.\n",
    "- Voting — Running the same task multiple times with different prompts or configurations to gather diverse perspectives,\n",
    "  then aggregating the results for a more reliable answer.\n",
    "\n",
    "## Setting up environment\n",
    "\n",
    "Let's start by configuring the Kotlin notebook with the necessary dependencies:"
   ]
  },
  {
   "metadata": {
    "ExecuteTime": {
     "end_time": "2025-04-04T15:32:47.216597Z",
     "start_time": "2025-04-04T15:32:46.223393Z"
    }
   },
   "cell_type": "code",
   "source": [
    "%useLatestDescriptors\n",
    "%use coroutines\n",
    "@file:DependsOn(\"dev.langchain4j:langchain4j:1.0.0-beta2\")\n",
    "@file:DependsOn(\"dev.langchain4j:langchain4j-anthropic:1.0.0-beta2\")"
   ],
   "outputs": [],
   "execution_count": 1
  },
  {
   "metadata": {},
   "cell_type": "markdown",
   "source": "Need an API key for accessing Claude:"
  },
  {
   "metadata": {
    "ExecuteTime": {
     "end_time": "2025-04-04T15:32:57.082525Z",
     "start_time": "2025-04-04T15:32:57.013499Z"
    }
   },
   "cell_type": "code",
   "source": "val apiKey = System.getenv(\"ANTHROPIC_API_KEY\")",
   "outputs": [],
   "execution_count": 2
  },
  {
   "metadata": {},
   "cell_type": "markdown",
   "source": [
    "## Creating LLM interface\n",
    "\n",
    "Next, define a helper function for making LLM calls"
   ]
  },
  {
   "metadata": {
    "ExecuteTime": {
     "end_time": "2025-04-04T15:33:32.793083Z",
     "start_time": "2025-04-04T15:33:32.326821Z"
    }
   },
   "cell_type": "code",
   "source": [
    "import dev.langchain4j.data.message.SystemMessage.systemMessage\n",
    "import dev.langchain4j.data.message.UserMessage.userMessage\n",
    "import dev.langchain4j.model.anthropic.AnthropicChatModel\n",
    "import dev.langchain4j.model.anthropic.AnthropicChatModelName\n",
    "import dev.langchain4j.model.chat.chat\n",
    "\n",
    "suspend fun llmCall(\n",
    "    prompt: String,\n",
    "    systemPrompt: String? = null,\n",
    "    model: AnthropicChatModelName = AnthropicChatModelName.CLAUDE_3_7_SONNET_20250219\n",
    "): String {\n",
    "    val client = AnthropicChatModel.builder()\n",
    "        .apiKey(apiKey)\n",
    "        .modelName(model)\n",
    "        .maxTokens(4096)\n",
    "        .temperature(0.1)\n",
    "        .build()\n",
    "\n",
    "    return withContext(Dispatchers.IO) {\n",
    "        val response = client.chat {\n",
    "            systemPrompt?.let { messages += systemMessage(it) }\n",
    "            messages += userMessage(prompt)\n",
    "        }\n",
    "        response.aiMessage().text()\n",
    "    }\n",
    "}"
   ],
   "outputs": [],
   "execution_count": 3
  },
  {
   "metadata": {},
   "cell_type": "markdown",
   "source": [
    "## Implementing parallel processing\n",
    "\n",
    "Now implement the core function for parallel processing:"
   ]
  },
  {
   "metadata": {
    "ExecuteTime": {
     "end_time": "2025-04-04T15:34:16.230882Z",
     "start_time": "2025-04-04T15:34:16.087338Z"
    }
   },
   "cell_type": "code",
   "source": [
    "/**\n",
    " * Process multiple inputs concurrently with the same prompt.\n",
    " */\n",
    "suspend fun parallel(prompt: String, inputs: List<String>, nWorkers: Int = 3): List<String> = coroutineScope {\n",
    "    // Create a dispatcher with a fixed thread pool\n",
    "    val dispatcher = Dispatchers.IO.limitedParallelism(nWorkers)\n",
    "\n",
    "    // Launch a coroutine for each input and collect the results\n",
    "    inputs.map { input: String ->\n",
    "        async(dispatcher) { llmCall(\"$prompt\\nInput: $input\") }\n",
    "    }.awaitAll()\n",
    "}"
   ],
   "outputs": [],
   "execution_count": 4
  },
  {
   "metadata": {},
   "cell_type": "markdown",
   "source": [
    "## Example with stakeholder impact analysis\n",
    "\n",
    "Let's test implementation with a business scenario —\n",
    "analyzing how market changes affect different stakeholder groups:"
   ]
  },
  {
   "metadata": {
    "ExecuteTime": {
     "end_time": "2025-04-04T15:35:30.206017Z",
     "start_time": "2025-04-04T15:35:30.160975Z"
    }
   },
   "cell_type": "code",
   "source": [
    "val stakeholders = listOf(\n",
    "    \"\"\"\n",
    "    Customers:\n",
    "    - Price sensitive\n",
    "    - Want better tech\n",
    "    - Environmental concerns\n",
    "    \"\"\",\n",
    "\n",
    "    \"\"\"\n",
    "    Employees:\n",
    "    - Job security worries\n",
    "    - Need new skills\n",
    "    - Want clear direction\n",
    "    \"\"\",\n",
    "\n",
    "    \"\"\"\n",
    "    Investors:\n",
    "    - Expect growth\n",
    "    - Want cost control\n",
    "    - Risk concerns\n",
    "    \"\"\",\n",
    "\n",
    "    \"\"\"\n",
    "    Suppliers:\n",
    "    - Capacity constraints\n",
    "    - Price pressures\n",
    "    - Tech transitions\n",
    "    \"\"\"\n",
    ")"
   ],
   "outputs": [],
   "execution_count": 5
  },
  {
   "metadata": {},
   "cell_type": "markdown",
   "source": "Run parallel processing"
  },
  {
   "metadata": {
    "ExecuteTime": {
     "end_time": "2025-04-04T15:36:00.539180Z",
     "start_time": "2025-04-04T15:35:49.430890Z"
    }
   },
   "cell_type": "code",
   "source": [
    "runBlocking {\n",
    "    val impactResults = parallel(\n",
    "        \"\"\"Analyze how market changes will impact this stakeholder group.\n",
    "    Provide specific impacts and recommended actions.\n",
    "    Format with clear sections and priorities.\"\"\",\n",
    "        stakeholders\n",
    "    )\n",
    "\n",
    "\n",
    "    impactResults.forEach {\n",
    "        print(it)\n",
    "    }\n",
    "}"
   ],
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "# Market Impact Analysis for Price-Sensitive, Tech-Focused, Environmentally Conscious Customers\n",
      "\n",
      "## Key Market Changes & Impacts\n",
      "\n",
      "### HIGH PRIORITY\n",
      "**1. Rising Inflation & Cost Pressures**\n",
      "* Customers will become increasingly price-sensitive and may delay purchases\n",
      "* Value perception will become critical to purchasing decisions\n",
      "* Potential shift to lower-cost alternatives or extending product lifecycles\n",
      "\n",
      "**2. Technology Acceleration**\n",
      "* Growing expectation gap between current products and latest innovations\n",
      "* Increased demand for seamless integration with other devices/platforms\n",
      "* Higher abandonment rate for products perceived as technologically outdated\n",
      "\n",
      "### MEDIUM PRIORITY\n",
      "**3. Environmental Regulation & Awareness**\n",
      "* Growing scrutiny of product sustainability credentials\n",
      "* Willingness to pay premium for genuinely eco-friendly options\n",
      "* Potential boycotts of brands perceived as environmentally harmful\n",
      "\n",
      "**4. Economic Uncertainty**\n",
      "* More deliberate, research-intensive purchasing decisions\n",
      "* Increased focus on product longevity and durability\n",
      "* Greater demand for flexible payment options\n",
      "\n",
      "## Recommended Actions\n",
      "\n",
      "### IMMEDIATE ACTIONS (0-6 months)\n",
      "1. **Implement transparent value communication strategy**\n",
      "   * Clearly articulate price-to-value ratio in all marketing\n",
      "   * Develop comparison tools highlighting long-term cost benefits\n",
      "\n",
      "2. **Launch tech upgrade program**\n",
      "   * Create affordable upgrade paths for existing customers\n",
      "   * Introduce modular product designs allowing component updates\n",
      "\n",
      "3. **Enhance sustainability messaging**\n",
      "   * Quantify environmental benefits in concrete terms\n",
      "   * Obtain relevant eco-certifications for products\n",
      "\n",
      "### SHORT-TERM ACTIONS (6-12 months)\n",
      "1. **Develop tiered product offerings**\n",
      "   * Create good/better/best options at various price points\n",
      "   * Implement subscription models to reduce upfront costs\n",
      "\n",
      "2. **Establish environmental leadership position**\n",
      "   * Launch take-back/recycling program\n",
      "   * Transition to sustainable packaging and materials\n",
      "\n",
      "3. **Enhance digital experience**\n",
      "   * Improve online product education and comparison tools\n",
      "   * Develop AR/VR capabilities to demonstrate product benefits remotely\n",
      "\n",
      "### LONG-TERM STRATEGY (12+ months)\n",
      "1. **Reimagine product development process**\n",
      "   * Incorporate customer co-creation in design phases\n",
      "   * Build environmental considerations into product architecture\n",
      "\n",
      "2. **Develop ecosystem approach**\n",
      "   * Create complementary products that enhance value of core offerings\n",
      "   * Build community around sustainable technology adoption\n",
      "\n",
      "3. **Establish price-value leadership**\n",
      "   * Invest in manufacturing efficiencies to reduce costs\n",
      "   * Develop breakthrough technologies that deliver exceptional value# Market Impact Analysis for Employees\n",
      "\n",
      "## Key Impacts\n",
      "\n",
      "### 1. Job Security Concerns\n",
      "* Market volatility creates uncertainty about long-term employment stability\n",
      "* Potential restructuring or role changes as company adapts to market conditions\n",
      "* Increased stress and decreased productivity due to job insecurity\n",
      "\n",
      "### 2. Skills Gap Challenges\n",
      "* Rapidly evolving market requires new technical and adaptive capabilities\n",
      "* Current skillsets may become outdated as industry demands shift\n",
      "* Competition from external candidates with market-relevant skills\n",
      "\n",
      "### 3. Direction and Leadership Needs\n",
      "* Unclear strategic vision during market transitions affects employee confidence\n",
      "* Difficulty aligning individual contributions with changing organizational goals\n",
      "* Potential communication gaps between leadership and workforce\n",
      "\n",
      "## Recommended Actions\n",
      "\n",
      "### High Priority\n",
      "1. **Implement transparent communication strategy**\n",
      "   * Schedule regular town halls addressing market changes and company response\n",
      "   * Create dedicated intranet section for market updates and implications\n",
      "   * Establish anonymous feedback channels for employee concerns\n",
      "\n",
      "2. **Develop comprehensive skills development program**\n",
      "   * Conduct skills gap analysis against market requirements\n",
      "   * Allocate budget for targeted training in high-demand areas\n",
      "   * Create mentorship opportunities with experienced team members\n",
      "\n",
      "### Medium Priority\n",
      "1. **Enhance job security measures**\n",
      "   * Clearly communicate criteria for retention decisions\n",
      "   * Develop internal mobility program to retain talent in different roles\n",
      "   * Consider flexible work arrangements to reduce overhead costs\n",
      "\n",
      "2. **Strengthen leadership alignment**\n",
      "   * Ensure consistent messaging across all management levels\n",
      "   * Provide managers with market intelligence to address team questions\n",
      "   * Create cross-functional teams to address market challenges\n",
      "\n",
      "### Long-term Considerations\n",
      "1. **Build organizational resilience**\n",
      "   * Develop succession planning for critical roles\n",
      "   * Create culture of continuous learning and adaptability\n",
      "   * Implement recognition programs for employees embracing change\n",
      "\n",
      "2. **Align compensation with market realities**\n",
      "   * Review compensation structure against changing market conditions\n",
      "   * Consider performance incentives tied to new strategic priorities\n",
      "   * Explore non-monetary benefits that address employee concerns# Market Impact Analysis for Investors\n",
      "\n",
      "## Key Impacts\n",
      "\n",
      "### 1. Return on Investment Pressure\n",
      "* Market volatility may challenge growth expectations\n",
      "* Competitive landscape intensifying, potentially squeezing margins\n",
      "* Longer timelines to profitability in uncertain economic conditions\n",
      "\n",
      "### 2. Risk Exposure Concerns\n",
      "* Increased regulatory scrutiny creating compliance costs\n",
      "* Market consolidation threatening competitive positioning\n",
      "* Potential for rapid technology shifts requiring additional capital\n",
      "\n",
      "### 3. Cost Management Challenges\n",
      "* Inflationary pressures affecting operational expenses\n",
      "* Talent acquisition costs rising in competitive sectors\n",
      "* Supply chain disruptions potentially increasing procurement costs\n",
      "\n",
      "## Recommended Actions\n",
      "\n",
      "### High Priority\n",
      "1. **Enhance Transparency in Reporting**\n",
      "   * Implement more frequent performance updates\n",
      "   * Develop clear metrics for measuring progress against growth targets\n",
      "   * Provide detailed risk mitigation strategies in quarterly reports\n",
      "\n",
      "2. **Optimize Capital Allocation**\n",
      "   * Review investment portfolio for underperforming assets\n",
      "   * Prioritize initiatives with strongest ROI potential\n",
      "   * Consider strategic divestments in high-risk market segments\n",
      "\n",
      "### Medium Priority\n",
      "1. **Strengthen Cost Control Mechanisms**\n",
      "   * Implement advanced analytics for expense monitoring\n",
      "   * Explore automation opportunities to reduce operational costs\n",
      "   * Develop contingency budgets for market disruptions\n",
      "\n",
      "2. **Diversify Growth Strategies**\n",
      "   * Balance high-growth initiatives with stable revenue streams\n",
      "   * Explore strategic partnerships to share risk and resources\n",
      "   * Consider geographic expansion to reduce market concentration risk\n",
      "\n",
      "### Long-term Considerations\n",
      "1. **Align Incentive Structures**\n",
      "   * Review compensation models to ensure alignment with investor priorities\n",
      "   * Develop performance metrics that balance growth with cost efficiency\n",
      "   * Create accountability for risk management at executive level\n",
      "\n",
      "2. **Build Resilience Planning**\n",
      "   * Develop scenario analyses for various market conditions\n",
      "   * Create early warning systems for emerging market risks\n",
      "   * Establish clear communication protocols for market disruptions# Market Impact Analysis for Suppliers\n",
      "\n",
      "## Key Impacts\n",
      "\n",
      "### 1. Capacity Constraints\n",
      "* **Supply chain bottlenecks** limiting production capabilities\n",
      "* **Increased lead times** affecting delivery schedules\n",
      "* **Inability to meet growing demand** from customers\n",
      "* **Resource allocation challenges** across customer base\n",
      "\n",
      "### 2. Price Pressures\n",
      "* **Rising raw material costs** squeezing profit margins\n",
      "* **Inflationary pressures** affecting operational expenses\n",
      "* **Competitive pricing environment** limiting ability to pass costs to customers\n",
      "* **Contract renegotiation requests** from cost-conscious buyers\n",
      "\n",
      "### 3. Technology Transitions\n",
      "* **Legacy systems becoming obsolete** requiring significant investment\n",
      "* **New skill requirements** for workforce\n",
      "* **Integration challenges** with customer systems\n",
      "* **R&D investment needs** to remain competitive\n",
      "\n",
      "## Recommended Actions (Prioritized)\n",
      "\n",
      "### Immediate Priorities (0-3 months)\n",
      "1. **Conduct capacity assessment and optimization**\n",
      "   * Map current bottlenecks and constraints\n",
      "   * Implement lean manufacturing principles\n",
      "   * Develop contingency plans for peak demand periods\n",
      "\n",
      "2. **Implement strategic pricing models**\n",
      "   * Develop value-based pricing strategies\n",
      "   * Create tiered service offerings\n",
      "   * Establish cost-plus contracts with material price adjustment clauses\n",
      "\n",
      "### Medium-Term Actions (3-12 months)\n",
      "1. **Develop technology roadmap**\n",
      "   * Assess current technological capabilities against market trends\n",
      "   * Prioritize investments in critical technologies\n",
      "   * Create phased implementation plan\n",
      "\n",
      "2. **Strengthen supplier relationships**\n",
      "   * Diversify supplier base to reduce dependency\n",
      "   * Negotiate long-term agreements with key suppliers\n",
      "   * Explore collaborative forecasting with customers\n",
      "\n",
      "### Long-Term Strategies (12+ months)\n",
      "1. **Invest in automation and digitalization**\n",
      "   * Implement advanced manufacturing technologies\n",
      "   * Develop digital twins for production optimization\n",
      "   * Explore AI/ML for predictive maintenance\n",
      "\n",
      "2. **Build workforce capabilities**\n",
      "   * Develop training programs for new technologies\n",
      "   * Recruit specialized talent in emerging tech areas\n",
      "   * Create knowledge transfer systems\n",
      "\n",
      "## Performance Metrics to Track\n",
      "* Production capacity utilization\n",
      "* On-time delivery rates\n",
      "* Profit margin by product/service line\n",
      "* Technology adoption ROI\n",
      "* Customer satisfaction scores"
     ]
    }
   ],
   "execution_count": 6
  },
  {
   "metadata": {},
   "cell_type": "markdown",
   "source": [
    "## How it works\n",
    "\n",
    "1. Define a common analysis prompt that will be applied to each stakeholder group\n",
    "2. Launch multiple concurrent LLM tasks, each analyzing a different stakeholder\n",
    "3. Kotlin's coroutines handle the concurrency, managing thread allocation efficiently\n",
    "4. Results are collected in the same order as the inputs\n",
    "\n",
    "This approach significantly improves processing time compared to sequential processing, especially for larger numbers of inputs.\n",
    "\n",
    "## Conclusion\n",
    "\n",
    "Parallelization offers a powerful approach to building more effective AI agents by leveraging concurrency.\n",
    "Whether through sectioning complex tasks or gathering diverse perspectives through voting,\n",
    "this pattern helps create systems that are faster, more reliable, and produce higher quality results.\n",
    "\n",
    "Kotlin's coroutines provide an elegant way to implement these patterns,\n",
    "making concurrent LLM processing both efficient and readable."
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Kotlin",
   "language": "kotlin",
   "name": "kotlin"
  },
  "language_info": {
   "name": "kotlin",
   "version": "1.9.23",
   "mimetype": "text/x-kotlin",
   "file_extension": ".kt",
   "pygments_lexer": "kotlin",
   "codemirror_mode": "text/x-kotlin",
   "nbconvert_exporter": ""
  }
 },
 "nbformat": 4,
 "nbformat_minor": 0
}