Skip to content
Merged
Show file tree
Hide file tree
Changes from 3 commits
Commits
Show all changes
41 commits
Select commit Hold shift + click to select a range
47a9cfb
feat: Added offline store remote deployment functionly using arrow fl…
redhatHameed May 7, 2024
088d739
Initial functional commit for remote get_historical_features
dmartinol May 9, 2024
241fe50
remote offline store example
dmartinol May 9, 2024
e276704
removing unneeded test code and fixinf impotrts
dmartinol May 9, 2024
cdd8a4e
call do_put only once, postpone the invocation of do_put and simplifi…
dmartinol May 10, 2024
54f6061
added primitive parameters to the command descriptor
dmartinol May 10, 2024
be91d23
removed redundant param
dmartinol May 13, 2024
f074044
Initial skeleton of unit test for offline server
dmartinol May 15, 2024
06fe80d
added unit test for offline store remote client
redhatHameed May 14, 2024
49857da
testing all offlinestore APIs
dmartinol May 17, 2024
a30c666
integrated comments
dmartinol May 17, 2024
2c8d677
Updated remote offline server readme with the capability to init with…
tmihalac May 17, 2024
1bca528
added RemoteOfflineStoreDataSourceCreator,
dmartinol May 27, 2024
f035430
added missing CI requirement
dmartinol May 27, 2024
632a4c0
fixed linter
dmartinol May 27, 2024
94f927b
fixed multiprocess CI requirement
dmartinol May 27, 2024
36b3479
feat: Added offline store remote deployment functionly using arrow fl…
redhatHameed May 7, 2024
799ae07
fix test errors
dmartinol May 29, 2024
3029881
managing feature view aliases and restored skipped tests
dmartinol May 29, 2024
f6c481b
fixced linter issue
dmartinol May 29, 2024
871e5d4
fixed broken test
dmartinol May 29, 2024
ddc3600
added supported deployment modes using helm chart for online (defaul…
redhatHameed May 22, 2024
9a34251
updated the document for offline remote server
redhatHameed Jun 4, 2024
efeeeae
added the document for remote offline server
redhatHameed Jun 4, 2024
7077bee
rebase and fix conflicts
redhatHameed Jun 6, 2024
5697056
feat: Added offline store remote deployment functionly using arrow fl…
redhatHameed May 7, 2024
f9ca13b
added unit test for offline store remote client
redhatHameed May 14, 2024
46fa3d5
added RemoteOfflineStoreDataSourceCreator,
dmartinol May 27, 2024
b36105a
feat: Added offline store remote deployment functionly using arrow fl…
redhatHameed May 7, 2024
2f4a5ba
Added missing remote offline store apis implementation
tmihalac Jun 4, 2024
52b0156
Fixed tests
tmihalac Jun 5, 2024
32600fc
Implemented PR change proposal
tmihalac Jun 6, 2024
d2e012c
Implemented PR change proposal
tmihalac Jun 6, 2024
301021f
updated example readme file
redhatHameed Jun 7, 2024
e34b070
Implemented PR change proposal
tmihalac Jun 10, 2024
dec05c9
fixing the integration tests
redhatHameed Jun 11, 2024
143ef18
Fixed OfflineServer teardown
tmihalac Jun 10, 2024
bd9cd79
updated the document for remote offline feature server and client
redhatHameed Jun 13, 2024
bdf0150
Merge pull request #15 from redhatHameed/doc-change
redhatHameed Jun 13, 2024
17c7e72
Implemented PR change proposal
tmihalac Jun 13, 2024
11a3dae
Merge pull request #16 from tmihalac/implement-remaining-offline-methods
tmihalac Jun 13, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 2 additions & 1 deletion docs/SUMMARY.md
Original file line number Diff line number Diff line change
Expand Up @@ -85,6 +85,7 @@
* [PostgreSQL (contrib)](reference/offline-stores/postgres.md)
* [Trino (contrib)](reference/offline-stores/trino.md)
* [Azure Synapse + Azure SQL (contrib)](reference/offline-stores/mssql.md)
* [Remote Offline](reference/offline-stores/remote-offline-store.md)
* [Online stores](reference/online-stores/README.md)
* [Overview](reference/online-stores/overview.md)
* [SQLite](reference/online-stores/sqlite.md)
Expand Down Expand Up @@ -117,7 +118,7 @@
* [Python feature server](reference/feature-servers/python-feature-server.md)
* [\[Alpha\] Go feature server](reference/feature-servers/go-feature-server.md)
* [\[Alpha\] AWS Lambda feature server](reference/feature-servers/alpha-aws-lambda-feature-server.md)
* [Remote Offline Store ](reference/feature-servers/remote-offline-store.md)
* [Offline Feature Server](reference/feature-servers/offline-feature-server)

* [\[Beta\] Web UI](reference/alpha-web-ui.md)
* [\[Alpha\] On demand feature view](reference/alpha-on-demand-feature-view.md)
Expand Down
4 changes: 4 additions & 0 deletions docs/reference/feature-servers/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,4 +12,8 @@ Feast users can choose to retrieve features from a feature server, as opposed to

{% content-ref url="alpha-aws-lambda-feature-server.md" %}
[alpha-aws-lambda-feature-server.md](alpha-aws-lambda-feature-server.md)
{% endcontent-ref %}

{% content-ref url="offline-feature-server.md" %}
[offline-feature-server.md](offline-feature-server.md)
{% endcontent-ref %}
35 changes: 35 additions & 0 deletions docs/reference/feature-servers/offline-feature-server.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,35 @@
# Offline feature server

## Description

The Offline feature server is an Apache Arrow Flight Server that uses the gRPC communication protocol to exchange data.
This server wraps calls to existing offline store implementations and exposes interfaces as Arrow Flight endpoints.

## How to configure the server

## CLI

There is a CLI command that starts the Offline feature server: `feast serve_offline`. By default, remote offline server uses port 8815, the port can be overridden with a `--port` flag.

## Deploying as a service on Kubernetes

The Offline feature server can be deployed using helm chart see this [helm chart](https://github.com/feast-dev/feast/blob/master/infra/charts/feast-feature-server).

User need to set `feast_mode=offline`, when installing Offline feature server as shown in the helm command below:

```
helm install feast-offline-server feast-charts/feast-feature-server --set feast_mode=offline --set feature_store_yaml_base64=$(base64 > feature_store.yaml)
```

## Server Example

The complete example can be find under [remote-offline-store-example](../../../examples/remote-offline-store)

## How to configure the client

Please see the detail how to configure offline store client [remote-offline-store.md](../offline-stores/remote-offline-store.md)

## Functionality Matrix

The set of functionalities supported by remote offline stores is the same as those supported by offline stores with the SDK, which are described in detail [here](../offline-stores/overview.md#functionality).

42 changes: 0 additions & 42 deletions docs/reference/feature-servers/remote-offline-store.md

This file was deleted.

28 changes: 28 additions & 0 deletions docs/reference/offline-stores/remote-offline-store.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,28 @@
# Remote Offline Store

## Description

The Remote Offline Store is an Arrow Flight client for the offline store that implements the `RemoteOfflineStore` class using the existing `OfflineStore` interface.
The client implements various methods, including `get_historical_features`, `pull_latest_from_table_or_query`, `write_logged_features`, and `offline_write_batch`.

## How to configure the client

User needs to create client side `feature_store.yaml` file and set the `offline_store` type `remote` and provide the server connection configuration
including adding the host and specifying the port (default is 8815) required by the Arrow Flight client to connect with the Arrow Flight server.

{% code title="feature_store.yaml" %}
```yaml
offline_store:
type: remote
host: localhost
port: 8815
```
{% endcode %}

## Client Example

The complete example can be find under [remote-offline-store-example](../../../examples/remote-offline-store)

## How to configure the server

Please see the detail how to configure offline feature server [offline-feature-server.md](../feature-servers/offline-feature-server.md)
Original file line number Diff line number Diff line change
Expand Up @@ -416,7 +416,7 @@ def create_offline_store_config(self) -> FeastConfigBaseModel:

def teardown(self):
super().teardown()
if self.proc is None and self.proc.is_alive():
if self.proc is not None:
self.proc.kill()

# wait server to free the port
Expand Down