Generate Videos and Images from Text in Jinba Flow

Use KLING_TEXT_TO_VIDEO and LUMA_TEXT_TO_VIDEO to generate video, and LUMA_TEXT_TO_IMAGE to generate images from text descriptions.

AI Video Generation tools allow you to create high-quality videos from simple text descriptions using advanced AI models. These tools support multiple video formats, aspect ratios, and durations for various use cases.

• LUMA_TEXT_TO_VIDEO
  • Generate videos using Luma AI’s models (model: ray-2 (default), ray-flash-2, ray-1-6)
  • resolution: 540p, 720p (default), 1080p, or 4k; aspect_ratio: 16:9 (default), 9:16, 1:1, 4:3, 3:4, 21:9
  • duration: 5s (default) or 10s; set loop to true for a seamlessly looping video
  • Returns video_url, thumbnail_url, generation_id, status, width, height, and duration
• LUMA_TEXT_TO_IMAGE
  • Generate images from text descriptions (model: photon-1 (default) or photon-flash-1; aspect_ratio: 1:1, 3:4, 4:3, 9:16, 16:9 (default), 9:21, 21:9)
  • Returns image_url, generation_id, status, width, and height
• KLING_TEXT_TO_VIDEO
  • Generate videos using Kling AI’s models (model: v2/master (default) or v1.6/standard)
  • duration: 5 (default) or 10 seconds; aspect_ratio: 16:9 (default), 9:16, 1:1; optional negative_prompt and cfg_scale (0–1, default 0.5)
  • Returns video_url, status, duration, and aspect_ratio

All generation options are step inputs; the only configuration field is the api_key.

For further details, click here and click here.

To use video generation tools, you need API keys from the respective services:

• Luma AI: Obtain from Luma AI website
• Kling AI: Obtain from Kling AI website

Note: Treat API keys as sensitive information and never commit them to public repositories.

Generate a video from text

- id: generate_marketing_video
  name: generate_marketing_video
  tool: LUMA_TEXT_TO_VIDEO
  config:
    - name: api_key
      value: "{{secrets.LUMA_API_KEY}}"
  input:
    - name: prompt
      value: |
        A professional product showcase video featuring a sleek smartphone 
        rotating slowly on a white background with soft lighting. The phone 
        displays a modern app interface. Camera slowly zooms in to highlight 
        the premium build quality and design details.
    - name: model
      value: "ray-2"
    - name: aspect_ratio
      value: "16:9"
    - name: resolution
      value: "1080p"
    - name: duration
      value: "10s"
    - name: loop
      value: false

- id: generate_social_media_video
  name: generate_social_media_video
  tool: KLING_TEXT_TO_VIDEO
  config:
    - name: api_key
      value: "{{secrets.KLING_API_KEY}}"
  input:
    - name: prompt
      value: |
        A vibrant animated scene of a person working at a coffee shop, 
        typing on a laptop with steam rising from their coffee cup. 
        Warm afternoon sunlight streaming through the window. 
        Perfect for social media content about productivity and lifestyle.
    - name: aspect_ratio
      value: "9:16"
    - name: duration
      value: "5"

Example: Video Content Creation Pipeline

- id: get_video_brief
  name: get_video_brief
  tool: INPUT_JSON_WITH_VALIDATION
  input:
    - name: value
      value: '{"video_type": "product_demo", "product_name": "Smart Watch", "target_audience": "fitness enthusiasts", "duration": "10s", "style": "modern_minimal"}'

- id: generate_video_script
  name: generate_video_script
  tool: OPENAI_INVOKE
  needs: [get_video_brief]
  config:
    - name: version
      value: gpt-5.2
  input:
    - name: prompt
      value: |
        Create a detailed video description/prompt for AI video generation based on this brief:
        
        Product: {{steps.get_video_brief.result.product_name}}
        Target Audience: {{steps.get_video_brief.result.target_audience}}
        Duration: {{steps.get_video_brief.result.duration}}
        Style: {{steps.get_video_brief.result.style}}
        Type: {{steps.get_video_brief.result.video_type}}
        
        Requirements:
        1. Write a detailed visual description for AI video generation
        2. Include camera movements, lighting, and composition details
        3. Specify product positioning and key features to highlight
        4. Ensure the description fits the target duration
        5. Match the requested visual style
        
        Format the output as a single, detailed prompt suitable for AI video generation.

- id: create_main_video
  name: create_main_video
  tool: LUMA_TEXT_TO_VIDEO
  needs: [get_video_brief, generate_video_script]
  config:
    - name: api_key
      value: "{{secrets.LUMA_API_KEY}}"
  input:
    - name: prompt
      value: "{{steps.generate_video_script.result.content}}"
    - name: model
      value: "ray-2"
    - name: aspect_ratio
      value: "16:9"
    - name: duration
      value: "{{steps.get_video_brief.result.duration}}"

- id: create_social_variant
  name: create_social_variant
  tool: KLING_TEXT_TO_VIDEO
  needs: [generate_video_script]
  config:
    - name: api_key
      value: "{{secrets.KLING_API_KEY}}"
  input:
    - name: prompt
      value: |
        Vertical social media version: {{steps.generate_video_script.result.content}}
        Optimized for mobile viewing with close-up shots and dynamic movement.
    - name: aspect_ratio
      value: "9:16"
    - name: duration
      value: "5"

Example: Video Generation with Quality Control

- id: generate_video_options
  name: generate_video_options
  tool: PYTHON_SANDBOX_RUN
  input:
    - name: data_type
      value: OBJECT
    - name: code
      value: |
        import json
        
        base_prompt = "A professional presentation of a new mobile app interface"
        
        # Generate variations for A/B testing
        variations = [
            {
                "name": "version_a_minimal",
                "prompt": f"{base_prompt} with minimal design, clean white background, subtle animations",
                "model": "ray-2",
                "aspect_ratio": "16:9"
            },
            {
                "name": "version_b_dynamic",
                "prompt": f"{base_prompt} with dynamic camera movements, colorful gradient background, energetic transitions",
                "model": "ray-flash-2",
                "aspect_ratio": "16:9"
            },
            {
                "name": "version_c_social",
                "prompt": f"{base_prompt} optimized for social media, vertical format, engaging visual effects",
                "model": "ray-2",
                "aspect_ratio": "9:16"
            }
        ]
        
        print(json.dumps({"variations": variations}))

- id: create_version_a
  name: create_version_a
  tool: LUMA_TEXT_TO_VIDEO
  needs: [generate_video_options]
  config:
    - name: api_key
      value: "{{secrets.LUMA_API_KEY}}"
  input:
    - name: prompt
      value: "{{steps.generate_video_options.result.data.variations[0].prompt}}"
    - name: model
      value: "{{steps.generate_video_options.result.data.variations[0].model}}"
    - name: aspect_ratio
      value: "{{steps.generate_video_options.result.data.variations[0].aspect_ratio}}"
    - name: duration
      value: "10s"

- id: create_version_b
  name: create_version_b
  tool: LUMA_TEXT_TO_VIDEO
  needs: [generate_video_options]
  config:
    - name: api_key
      value: "{{secrets.LUMA_API_KEY}}"
  input:
    - name: prompt
      value: "{{steps.generate_video_options.result.data.variations[1].prompt}}"
    - name: model
      value: "{{steps.generate_video_options.result.data.variations[1].model}}"
    - name: aspect_ratio
      value: "{{steps.generate_video_options.result.data.variations[1].aspect_ratio}}"
    - name: duration
      value: "10s"

- id: analyze_results
  name: analyze_results
  tool: PYTHON_SANDBOX_RUN
  needs: [create_version_a, create_version_b]
  input:
    - name: data_type
      value: OBJECT
    - name: code
      value: |
        import json
        
        # Compile results
        results = {
            "version_a": {
                "url": "{{steps.create_version_a.result.video_url}}",
                "status": "{{steps.create_version_a.result.status}}",
                "style": "minimal"
            },
            "version_b": {
                "url": "{{steps.create_version_b.result.video_url}}",
                "status": "{{steps.create_version_b.result.status}}",
                "style": "dynamic"
            }
        }
        
        print(json.dumps({"video_results": results}))

Generate an image and videos from text

- id: create_hero_image
  name: create_hero_image
  tool: LUMA_TEXT_TO_IMAGE
  config:
    - name: api_key
      value: "{{secrets.LUMA_API_KEY}}"
  input:
    - name: prompt
      value: |
        A stunning hero image for a tech startup website. Modern office space 
        with diverse team members collaborating around a large display showing 
        data visualizations. Professional lighting, clean design, inspiring 
        atmosphere. High-resolution, photorealistic.
    - name: model
      value: "photon-1"
    - name: aspect_ratio
      value: "16:9"

- id: create_background_video
  name: create_background_video
  tool: LUMA_TEXT_TO_VIDEO
  config:
    - name: api_key
      value: "{{secrets.LUMA_API_KEY}}"
  input:
    - name: prompt
      value: |
        Subtle background video for website hero section. Gentle floating 
        abstract particles and soft geometric shapes in corporate blue colors. 
        Minimal motion, professional feel, seamless loop. Perfect for website 
        background without being distracting.
    - name: model
      value: "ray-flash-2"
    - name: aspect_ratio
      value: "16:9"
    - name: duration
      value: "10s"
    - name: loop
      value: true

- id: create_product_showcase
  name: create_product_showcase
  tool: KLING_TEXT_TO_VIDEO
  config:
    - name: api_key
      value: "{{secrets.KLING_API_KEY}}"
  input:
    - name: prompt
      value: |
        Square format product showcase for Instagram. Modern laptop computer 
        on a clean desk setup with plants and coffee. Smooth 360-degree 
        rotation showing all angles. Premium aesthetic with natural lighting 
        and minimal shadows.
    - name: aspect_ratio
      value: "1:1"
    - name: duration
      value: "5"

Tips and Best Practices

• Use specific, detailed prompts for better video quality
• Choose the right model based on your needs (quality vs speed)
• Consider aspect ratio based on intended platform (16:9 for web, 9:16 for mobile)
• Test different prompt variations to find the best results
• Use looping for background videos and website elements
• Plan video duration based on platform requirements
• Include lighting, camera movement, and composition details in prompts
• Consider creating multiple versions for A/B testing
• Monitor API usage and costs for high-volume generation