Skip to content

[Task]: Remove hadoop-common pin from expansion service and Iceberg modules #38515

@ahmedabu98

Description

@ahmedabu98

What needs to happen?

Since updating gcsio (#38419), we've needed to pin hadoop-common to 3.3.6 in the Iceberg and expansion service modules to prevent dependency conflicts from breaking HadoopFileIO (#38500).

When parquet-hadoop comes out with a version that supports 3.4.2 (monitor dependencies), we should upgrade to that latest parquet-hadoop version and remove the hadoop-common pin.

Issue Priority

Priority: 2 (default / most normal work should be filed as P2)

Issue Components

  • Component: Python SDK
  • Component: Java SDK
  • Component: Go SDK
  • Component: Typescript SDK
  • Component: IO connector
  • Component: Beam YAML
  • Component: Beam examples
  • Component: Beam playground
  • Component: Beam katas
  • Component: Website
  • Component: Infrastructure
  • Component: Spark Runner
  • Component: Flink Runner
  • Component: Prism Runner
  • Component: Twister2 Runner
  • Component: Hazelcast Jet Runner
  • Component: Google Cloud Dataflow Runner

Metadata

Metadata

Assignees

No one assigned

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions