Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Some benchmarks with arrow strings #722

Open
wants to merge 11 commits into
base: main
Choose a base branch
from

Conversation

j-bennet
Copy link
Contributor

Some simple benchmarks with Arrow strings.

@j-bennet j-bennet force-pushed the j-bennet/benchmark-arrow-strings branch from 72c6fa0 to 0d9dae7 Compare March 17, 2023 21:31
@j-bennet j-bennet marked this pull request as draft March 17, 2023 23:01
@j-bennet j-bennet force-pushed the j-bennet/benchmark-arrow-strings branch 3 times, most recently from a4316ca to 9392386 Compare March 18, 2023 04:25
@j-bennet j-bennet marked this pull request as ready for review March 21, 2023 21:02
@j-bennet j-bennet force-pushed the j-bennet/benchmark-arrow-strings branch from 53b75a0 to a0d36cd Compare March 24, 2023 18:53
@j-bennet
Copy link
Contributor Author

@ntabris Can you advise what's going on with this?

coiled.errors.ServerError: You've reached your user active CPU limit. You can't create a cluster at this moment.

Is there anything I need to do?

@ntabris
Copy link
Member

ntabris commented Mar 31, 2023

Try again, that user quota was updated a while ago, it appears the error is from ~1 week ago.

@j-bennet
Copy link
Contributor Author

@ntabris Now I get a different error: coiled.errors.ClusterCreationError: Cluster status is error (reason: Timed out while waiting for workers/scheduler) (cluster_id: 181566)

@ntabris
Copy link
Member

ntabris commented Mar 31, 2023

Not sure what happened there. The scheduler started downloading senv and then we don't hear from it or get more logs. You might just try re-running.

coiled cluster logs --cluster 181566 --workers none --combined --since "2023-03-31 17:30:08"
(scheduler)     [2023-03-31 17:30:08,478][INFO    ] Fetching download url
  [2023-03-31 17:30:09,010][INFO    ] Downloading & extracting 46 chunk(s)

@shughes-uk or @dan-blanchard can you see if @j-bennet needs help next week.

@j-bennet
Copy link
Contributor Author

j-bennet commented Apr 3, 2023

@ntabris This PR keeps having problems with clusters. Now there's this:

FAILED tests/benchmarks/test_work_stealing.py::test_work_stealing_on_scaling_up - coiled.errors.ClusterCreationError: Cluster status is error (reason: Scheduler Stopped -> Environment failed to download, check cluster logs) (cluster_id: 184069)

@ncclementi
Copy link
Contributor

Nat is on PTO,
maybe @shughes-uk or @dan-blanchard can take a look at this?

@ntabris
Copy link
Member

ntabris commented Apr 3, 2023

Samantha and Dan are the people for package sync issues anyway

@shughes-uk
Copy link
Contributor

Let me know if there's anymore package sync issues. Thing should be resolved.

@j-bennet
Copy link
Contributor Author

@shughes-uk The CI is green, thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants