Jump to content

#spark

  1. A Deep Dive into the Latest Performance Improvements of Stateful Pipelines in Apache Spark Structured Streaming

    Databricks ·
    • 1 comment
    • 381 views
    Databricks
    Databricks

  2. Use Result Fragment Caching with EMR runtime for Apache Spark to boost query performance by up to 15x

    Amazon Web Services ·
    • 1 comment
    • 168 views
    Amazon Web Services
    Amazon Web Services

  3. Amazon EMR 6.6 adds support for Apache Spark 3.2, HUDI 0.10.1, Iceberg 0.13, Trino 0.367, PrestoDB 0.267, and more

    Amazon Web Services ·
    • 1 comment
    • 514 views
    Amazon Web Services
    Amazon Web Services

  4. Amazon SageMaker Processing now supports built-in Spark containers for big data processing

    Amazon Web Services ·
    • 3 comments
    • 581 views
    Guest
    Guest

  5. Amazon EMR now provides up to 30% lower cost and up to 15% improved performance for Spark workloads on Graviton2-based instances

    Amazon Web Services ·
    • 2 comments
    • 446 views
    Guest
    Guest

  6. AWS Glue now supports workload partitioning to further improve the reliability of Spark applications

    Amazon Web Services ·
    • 2 comments
    • 423 views
    Guest
    Guest