Skip to content

Commit f2cbf43

Browse files
authored
fix: Spark kafka processor sorting (#3479)
Fix spark_kafka_processor sort Signed-off-by: shaurya.rawat <[email protected]>
1 parent 4575ef0 commit f2cbf43

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

‎sdk/python/feast/infra/contrib/spark_kafka_processor.py‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -131,7 +131,7 @@ def batch_write(row: DataFrame, batch_id: int):
131131
# Also add a 'created' column.
132132
rows = (
133133
rows.sort_values(
134-
by=self.join_keys + [self.sfv.timestamp_field], ascending=True
134+
by=[*self.join_keys, self.sfv.timestamp_field], ascending=False
135135
)
136136
.groupby(self.join_keys)
137137
.nth(0)

0 commit comments

Comments
 (0)