Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit history

Commits on Nov 28, 2024

• [SPARK-50311][PYTHON] Support `(add|remove|get|clear)Tag(s)` APIs for PySpark

  Show description for 13c1da7
  itholic

  committed
  13c1da7

  Copy full SHA for 13c1da7

Commits on Nov 14, 2024

• [SPARK-48755][DOCS][PYTHON][FOLLOWUP] Add PySpark doc for `transformWithState`

  Show description for 09d6b32
  

  itholic

  authored and

  HyukjinKwon

  committed
  09d6b32

  Copy full SHA for 09d6b32

Commits on Nov 11, 2024

• [SPARK-50279][DOCS][PYTHON] Add DataFrame.plot to DataFrame API reference

  Show description for 039f796
  

  xinrong-meng

  authored and

  dongjoon-hyun

  committed
  039f796

  Copy full SHA for 039f796

Commits on Nov 7, 2024

• [SPARK-50055][SQL] Add TryMakeInterval alternative

  Show description for 9858ab6
  

  mihailomilosevic2001

  authored and

  MaxGekk

  committed
  9858ab6

  Copy full SHA for 9858ab6

• [SPARK-50251][PYTHON] Add `getSystemProperty` to PySpark `SparkContext`

  Show description for d9c596c
  dongjoon-hyun

  committed
  d9c596c

  Copy full SHA for d9c596c

Commits on Nov 6, 2024

• [SPARK-37178][ML] Add Target Encoding to ml.feature

  Show description for abe990e
  

  Enrique Rebollo

  and

  HyukjinKwon

  committed
  abe990e

  Copy full SHA for abe990e

• [SPARK-49601][SS][PYTHON] Support Initial State Handling for TransformWithStateInPandas

  Show description for 36410f0
  

  jingz-db

  authored and

  HeartSaVioR

  committed
  36410f0

  Copy full SHA for 36410f0

Commits on Oct 30, 2024

• [SPARK-50075][SQL][PYTHON][CONNECT] Add DataFrame APIs for table-valued functions

  Show description for cb59383
  

  ueshin

  authored and

  allisonwang-db

  committed
  cb59383

  Copy full SHA for cb59383

Commits on Oct 29, 2024

• [SPARK-50071][SQL][PYTHON] Add try_make_timestamp(_ltz and _ntz) and related tests

  Show description for 9968a32
  

  markonik-db

  authored and

  MaxGekk

  committed
  9968a32

  Copy full SHA for 9968a32

Commits on Oct 22, 2024

• [SPARK-50031][SQL] Add the `TryParseUrl` expression

  Show description for abc4986
  

  jovanm-db

  authored and

  MaxGekk

  committed
  abc4986

  Copy full SHA for abc4986

Commits on Oct 17, 2024

• [SPARK-49958][PYTHON] Python API for string validation functions

  Show description for 120ae9a
  

  uros-db

  authored and

  MaxGekk

  committed
  120ae9a

  Copy full SHA for 120ae9a

Commits on Sep 25, 2024

• [SPARK-49552][PYTHON] Add DataFrame API support for new 'randstr' and 'uniform' SQL functions

  Show description for e2d2ab5
  

  dtenedor

  authored and

  zhengruifeng

  committed
  e2d2ab5

  Copy full SHA for e2d2ab5

Commits on Sep 10, 2024

• [SPARK-49443][SQL][PYTHON] Implement to_variant_object expression and make schema_of_variant expressions print OBJECT for for Variant Objects

  Show description for 3709c2e
  

  harshmotw-db

  authored and

  cloud-fan

  committed
  3709c2e

  Copy full SHA for 3709c2e

Commits on Aug 28, 2024

• [SPARK-49306][PYTHON][SQL] Create SQL function aliases for 'zeroifnull' and 'nullifzero'

  Show description for a3cb064
  

  dtenedor

  authored and

  MaxGekk

  committed
  a3cb064

  Copy full SHA for a3cb064

Commits on Aug 23, 2024

• [SPARK-49344][PS] Support `json_normalize` for Pandas API on Spark

  Show description for 08d69ff
  

  itholic

  and

  HyukjinKwon

  committed
  08d69ff

  Copy full SHA for 08d69ff

Commits on Aug 15, 2024

• [SPARK-48755][SS][PYTHON] transformWithState pyspark base implementation and ValueState support

  Show description for def42d4
  

  2 peopleauthored and

  HeartSaVioR

  committed
  def42d4

  Copy full SHA for def42d4

Commits on Aug 1, 2024

• [MINOR][PS][DOCS] Add `DataFrame.plot.kde` to API reference

  Show description for c3bb64e
  

  zhengruifeng

  authored and

  HyukjinKwon

  committed
  c3bb64e

  Copy full SHA for c3bb64e

Commits on Jul 21, 2024

• [SPARK-48954] try_mod() replaces try_remainder()

  Show description for 15c98e0
  

  srielau

  authored and

  zhengruifeng

  committed
  15c98e0

  Copy full SHA for 15c98e0

Commits on Jul 18, 2024

• [SPARK-48752][PYTHON][CONNECT][DOCS] Introduce `pyspark.logger` for improved structured logging for PySpark

  Show description for 3b4c423
  

  itholic

  authored and

  HyukjinKwon

  committed
  3b4c423

  Copy full SHA for 3b4c423

Commits on Jul 17, 2024

• [SPARK-48865][SQL] Add try_url_decode function

  Show description for 41a2beb
  

  wForget

  and

  yaooqinn

  committed
  41a2beb

  Copy full SHA for 41a2beb

Commits on Jul 14, 2024

• [SPARK-48714][SPARK-48794][FOLLOW-UP][PYTHON][DOCS] Add `mergeInto` to API reference

  Show description for e07dc5a
  

  zhengruifeng

  authored and

  HyukjinKwon

  committed
  e07dc5a

  Copy full SHA for e07dc5a

Commits on Jun 25, 2024

• [SPARK-48638][CONNECT] Add ExecutionInfo support for DataFrame

  Show description for 9d4abaf
  

  grundprinzip

  authored and

  HyukjinKwon

  committed
  9d4abaf

  Copy full SHA for 9d4abaf

Commits on May 21, 2024

• [SPARK-48369][SQL][PYTHON][CONNECT] Add function `timestamp_add`

  Show description for 6e6e7a0
  zhengruifeng

  committed
  6e6e7a0

  Copy full SHA for 6e6e7a0

Commits on May 15, 2024

• [SPARK-48272][SQL][PYTHON][CONNECT] Add function `timestamp_diff`

  Show description for c03ebb4
  zhengruifeng

  committed
  c03ebb4

  Copy full SHA for c03ebb4

Commits on May 14, 2024

• [SPARK-41794][FOLLOWUP] Add `try_remainder` to python API references

  Show description for 4cc589a
  zhengruifeng

  committed
  4cc589a

  Copy full SHA for 4cc589a

Commits on May 9, 2024

• [SPARK-47365][PYTHON] Add toArrow() DataFrame method to PySpark

  Show description for ecca1bf
  

  ianmcook

  and

  HyukjinKwon

  committed
  ecca1bf

  Copy full SHA for ecca1bf

Commits on Apr 26, 2024

• [SPARK-47922][SQL] Implement the try_parse_json expression

  Show description for 033ca3e
  

  harshmotw-db

  authored and

  cloud-fan

  committed
  033ca3e

  Copy full SHA for 033ca3e

Commits on Apr 22, 2024

• [SPARK-47903][PYTHON] Add support for remaining scalar types in the PySpark Variant library

  Show description for 9e7ee76
  

  harshmotw-db

  authored and

  HyukjinKwon

  committed
  9e7ee76

  Copy full SHA for 9e7ee76

• [SPARK-47890][CONNECT][PYTHON] Add variant functions to Scala and Python

  Show description for 79a1fa4
  

  chenhao-db

  authored and

  HyukjinKwon

  committed
  79a1fa4

  Copy full SHA for 79a1fa4

Commits on Apr 11, 2024

• [SPARK-47366][SQL][PYTHON] Add VariantVal for PySpark

  Show description for f6d5ad3
  

  gene-db

  and

  HyukjinKwon

  committed
  f6d5ad3

  Copy full SHA for f6d5ad3

Commits on Apr 4, 2024

• [SPARK-47081][CONNECT] Support Query Execution Progress

  Show description for f6999df
  

  grundprinzip

  authored and

  cloud-fan

  committed
  f6999df

  Copy full SHA for f6999df

Commits on Apr 3, 2024

• [SPARK-47669][SQL][CONNECT][PYTHON] Add `Column.try_cast`

  Show description for 55b5ff6
  zhengruifeng

  committed
  55b5ff6

  Copy full SHA for 55b5ff6

Commits on Mar 28, 2024

• [SPARK-47366][PYTHON] Add pyspark and dataframe parse_json aliases

  Show description for 7f1eadc
  

  gene-db

  and

  HyukjinKwon

  committed
  7f1eadc

  Copy full SHA for 7f1eadc

Commits on Mar 21, 2024

• Revert "[SPARK-47007][SQL][PYTHON][R][CONNECT] Add the `map_sort` function"

  Show description for bb3e275
  cloud-fan

  committed
  bb3e275

  Copy full SHA for bb3e275

Commits on Mar 20, 2024

• [SPARK-47007][SQL][PYTHON][R][CONNECT] Add the `map_sort` function

  Show description for 747846b
  

  2 peopleauthored and

  MaxGekk

  committed
  747846b

  Copy full SHA for 747846b