using algolia for the search ? #205

mackwic · 2015-11-01T19:46:56Z

Hi crates.io !

I think crates.io is elligible for the free plan of algolia. Using their search engine would give a far better search experience for crates.

Things we can gain:

fuzzy search and other tricky substitutions
nice ranking
real-time response
maybe searching in the name + the description (not sure if the actual search do that)

I think it's primordial for crates.io to have a great search experience as it encourages the discoverabilty of the crates. As an illustration, doing cargo search net today will not show the library pnet. Using algolia would make the result more relevant.

What do you think ?

The text was updated successfully, but these errors were encountered:

alexcrichton · 2015-11-02T16:21:02Z

Sounds plausible to me! Right now we're just using basic postgres text search, but that's just because it was the easiest thing to setup initially. One thing I'd be curious about with algolia is if it's easy to run in development? Not really a blocker either way, just curious!

mackwic · 2015-11-02T21:18:28Z

I guess so ? It's a SaaS search engine, so you would just query with your testing dataset. I have to admit I never integrated Algolia so I don't really now... I think it's a common use-case.

I think @jerskouille can help us on the matter. :)

Jerska · 2015-11-02T22:20:08Z

Hi @alexcrichton !

We'd love to build a demo for you and create a pull request, but if you want to play with the API yourselves, feel free to create an account and to drop us a line for us to set you up as a community plan. :)

We've been working a lot on documentation search lately, and here are a few examples if you want to see it live:

We've also been working on some demos/tools for ourselves that you can check out here:

I think @mackwic already sold the product here, I just have a small correction to make, the engine doesn't support fuzzy matching, but you can definitely define some aliases.
We unfortunately don't have an algoliasearch crate yet, but we'll make sure to fix this issue in a near future, so you might want to stick with the current implementation in cargo right now (If you wanna try anyway, you can check our curl documentation here).

alexcrichton · 2015-11-02T23:43:43Z

Thanks for the info! Definitely seems like some good info to start from.

Turbo87 · 2015-11-04T10:01:35Z

There are only ~3000 crates (aka. objects) on crates.io right now, but I suspect that this number will grow quite a bit as time passes. From what I'm reading on https://www.algolia.com/pricing their free plan would limit us to a maximum of 10000 index objects. If we implemented search using their service we would limit ourselves to 10000 crates which doesn't seem like a good idea. Am I missing some kind of "free for open source" thing?

Jerska · 2015-11-04T10:20:59Z

@Turbo87 You're right about the specificity of open source projects with Algolia. We handle these on a case by case basis, but as you can see on the issue on the React.parts project, we'll grant the crates.io account an unlimited amount of operations and more than enough records to handle this growth.

Turbo87 · 2015-11-04T10:24:11Z

@jerskouille I see, thanks for clearing that up! 👍

carols10cents · 2019-10-09T14:23:33Z

I don't think we're going to do this.

…8.0.0, r=Turbo87 Bump ember-moment from 7.5.0 to 8.0.0 Bumps [ember-moment](https://github.com/stefanpenner/ember-moment) from 7.5.0 to 8.0.0. <details> <summary>Release notes</summary> *Sourced from [ember-moment's releases](https://github.com/stefanpenner/ember-moment/releases).* > ## Add smoke tests, travis ci now tests against 1.10->#release, fixes regression against Ember 1.10.0 > - Smoke tests added > - Fixing regression which broke 1.10.0 > - Added Ember 1.10.0 -> #release to the Travis CI matrix </details> <details> <summary>Changelog</summary> *Sourced from [ember-moment's changelog](https://github.com/stefanpenner/ember-moment/blob/master/CHANGELOG.md).* > ### 8.0.0 > > * [BREAKING] drops Node 6 support > * Updates ember-macro-helpers to 4.x > > ### 7.8.1 > > * [@puwelous](https://github.com/puwelous) Substitute merge() with assign() - Ember deprecation [#296](https://github-redirect.dependabot.com/stefanpenner/ember-moment/issues/296) > * [@jasonmit](https://github.com/jasonmit) ci: Bump Supported Node version from 4 to 6. > * [@kellyselden](https://github.com/kellyselden) update ember-macro-helpers [#285](https://github-redirect.dependabot.com/stefanpenner/ember-moment/issues/285) > * [@scottkidder](https://github.com/scottkidder) Replace Logger with console [#281](https://github-redirect.dependabot.com/stefanpenner/ember-moment/issues/281) > > ### 7.7.0 > > * [@fenekku](https://github.com/fenekku) deprecated hideSuffix/hidePrefix in favor of hideAffix > * [@crotwell](https://github.com/crotwell) added utc helper & macro > * > > ### 7.6.0 > > * [@kellyselden](https://github.com/kellyselden) Fix invalid reexport for helpers/unix > * Upgrade ember-cli and dependencies > > ### 7.3.0 > > * Setting locale now sets locale on global moment object > * Added `setLocale` and `setTimeZone`. Better naming. Will continue to support `changeLocale` and `changeTimeZone` but have updated README to prefer new method names > * Added `localeChanged` and `timeZoneChanged` events > * [@mfeltz](https://github.com/mfeltz) scoped moment-subtract and moment-add to use the moment service `locale` property > > ### 7.2.0 > > * [@kellyselden](https://github.com/kellyselden) add back `ember-macro-helpers` > > ### 7.1.1 > > * Removed `ember-macro-helpers` > > ### 7.1.0 > > * [@kellyselden](https://github.com/kellyselden) ported computed macro factory to use computed macro utility methods from `ember-macro-helpers` > > ### 7.0.3 > > * Upgrade `ember-cli-moment-shim` to 3.0.0 > * now helper now recomputes using setTimeout instead of run.later [#205](https://github-redirect.dependabot.com/stefanpenner/ember-moment/issues/205) > > ### 7.0.2 > > * Revert upgrade `ember-cli-moment-shim` to 2.2.1 (moment.now issue) ></tr></table> ... (truncated) </details> <details> <summary>Commits</summary> - [`7334cee`](adopted-ember-addons/ember-moment@7334cee) 8.0.0 - [`61aa2c1`](adopted-ember-addons/ember-moment@61aa2c1) chore: Update changelog. - [`4b56658`](adopted-ember-addons/ember-moment@4b56658) Merge pull request [#314](https://github-redirect.dependabot.com/stefanpenner/ember-moment/issues/314) from GreatWizard/update-ember-macro-helpers - [`bef3ffe`](adopted-ember-addons/ember-moment@bef3ffe) ci: update CI config and engines node to run on node 8 and upper - [`9e1bdcd`](adopted-ember-addons/ember-moment@9e1bdcd) chore: update ember-macro-helpers version to expose a recent one in dependency - [`f7eeb90`](adopted-ember-addons/ember-moment@f7eeb90) Merge pull request [#310](https://github-redirect.dependabot.com/stefanpenner/ember-moment/issues/310) from himynameisjonas/patch-1 - [`29e4029`](adopted-ember-addons/ember-moment@29e4029) Replace merge with assign - [`a14c935`](adopted-ember-addons/ember-moment@a14c935) Merge pull request [#305](https://github-redirect.dependabot.com/stefanpenner/ember-moment/issues/305) from mbinet/cleanup-readme - [`7469733`](adopted-ember-addons/ember-moment@7469733) Move contributing informations to dedicated file - [`2dc62a8`](adopted-ember-addons/ember-moment@2dc62a8) Add TOC - Additional commits viewable in [compare view](adopted-ember-addons/ember-moment@v7.5.0...v8.0.0) </details> <br /> [![Dependabot compatibility score](https://api.dependabot.com/badges/compatibility_score?dependency-name=ember-moment&package-manager=npm_and_yarn&previous-version=7.5.0&new-version=8.0.0)](https://dependabot.com/compatibility-score.html?dependency-name=ember-moment&package-manager=npm_and_yarn&previous-version=7.5.0&new-version=8.0.0) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- **Note:** This repo was added to Dependabot recently, so you'll receive a maximum of 5 PRs for your first few update runs. Once an update run creates fewer than 5 PRs we'll remove that limit. You can always request more updates by clicking `Bump now` in your [Dependabot dashboard](https://app.dependabot.com). <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) - `@dependabot use these labels` will set the current labels as the default for future PRs for this repo and language - `@dependabot use these reviewers` will set the current reviewers as the default for future PRs for this repo and language - `@dependabot use these assignees` will set the current assignees as the default for future PRs for this repo and language - `@dependabot use this milestone` will set the current milestone as the default for future PRs for this repo and language - `@dependabot badge me` will comment on this PR with code to add a "Dependabot enabled" badge to your readme Additionally, you can set the following in your Dependabot [dashboard](https://app.dependabot.com): - Update frequency (including time of day and day of week) - Pull request limits (per update run and/or open at any time) - Automerge options (never/patch/minor, and dev/runtime dependencies) - Out-of-range updates (receive only lockfile updates, if desired) - Security updates (receive only security updates, if desired) </details>

mackwic changed the title ~~use algolia for the search ?~~ using algolia for the search ? Nov 1, 2015

carols10cents added A-search C-enhancement ✨ Category: Adding new behavior or a change to the way an existing feature works labels Dec 15, 2016

kureuil mentioned this issue Sep 5, 2017

Idea: use a search engine to power search #1041

Open

carols10cents closed this as completed Oct 9, 2019

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

using algolia for the search ? #205

using algolia for the search ? #205

mackwic commented Nov 1, 2015

alexcrichton commented Nov 2, 2015

mackwic commented Nov 2, 2015

Jerska commented Nov 2, 2015

alexcrichton commented Nov 2, 2015

Turbo87 commented Nov 4, 2015

Jerska commented Nov 4, 2015

Turbo87 commented Nov 4, 2015

carols10cents commented Oct 9, 2019

using algolia for the search ? #205

using algolia for the search ? #205

Comments

mackwic commented Nov 1, 2015

alexcrichton commented Nov 2, 2015

mackwic commented Nov 2, 2015

Jerska commented Nov 2, 2015

alexcrichton commented Nov 2, 2015

Turbo87 commented Nov 4, 2015

Jerska commented Nov 4, 2015

Turbo87 commented Nov 4, 2015

carols10cents commented Oct 9, 2019