Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Index and update every job to an ElasticSearch document #5

Closed
6 tasks done
mmenozzi opened this issue Sep 9, 2019 · 1 comment
Closed
6 tasks done

Index and update every job to an ElasticSearch document #5

mmenozzi opened this issue Sep 9, 2019 · 1 comment
Assignees
Labels
ES Console ElasticSearch Console for jobs search and re-queue.

Comments

@mmenozzi
Copy link
Member

mmenozzi commented Sep 9, 2019

To be able to fetch job data easily and quickly in a web console, every job should be indexed into an ElasticSearch document. Alongside with job data also a kind of "job state" should be indexed as well (for example the state that the job has in the Beanstalk queue).

  • Index new job just when produced
  • Update already indexed job when reserved by worker
  • Update already indexed job when successfully worked by worker
  • Update already indexed job when worked with error by worker
  • Remove usage of temporary repo https://github.com/mmenozzi/amp-elasticsearch
  • Check if a new Job's uuid is already indexed onto ElasticSearch and throw it's the case
@mmenozzi mmenozzi added the ES Console ElasticSearch Console for jobs search and re-queue. label Sep 9, 2019
@mmenozzi mmenozzi self-assigned this Oct 7, 2019
mmenozzi added a commit that referenced this issue Oct 24, 2019
mmenozzi added a commit that referenced this issue Oct 25, 2019
mmenozzi added a commit that referenced this issue Oct 25, 2019
mmenozzi added a commit that referenced this issue Nov 4, 2019
mmenozzi added a commit that referenced this issue Nov 13, 2019
@mmenozzi
Copy link
Member Author

Merged in master. Closing.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ES Console ElasticSearch Console for jobs search and re-queue.
Projects
None yet
Development

No branches or pull requests

1 participant