2024-03-09T18:47:04,274 Created temporary directory: /tmp/pip-build-tracker-j50l8eut 2024-03-09T18:47:04,276 Initialized build tracking at /tmp/pip-build-tracker-j50l8eut 2024-03-09T18:47:04,276 Created build tracker: /tmp/pip-build-tracker-j50l8eut 2024-03-09T18:47:04,277 Entered build tracker: /tmp/pip-build-tracker-j50l8eut 2024-03-09T18:47:04,278 Created temporary directory: /tmp/pip-wheel-5jloo0ez 2024-03-09T18:47:04,281 Created temporary directory: /tmp/pip-ephem-wheel-cache-cuhvqbh8 2024-03-09T18:47:04,303 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-03-09T18:47:04,306 2 location(s) to search for versions of ochat: 2024-03-09T18:47:04,306 * https://pypi.org/simple/ochat/ 2024-03-09T18:47:04,306 * https://www.piwheels.org/simple/ochat/ 2024-03-09T18:47:04,307 Fetching project page and analyzing links: https://pypi.org/simple/ochat/ 2024-03-09T18:47:04,308 Getting page https://pypi.org/simple/ochat/ 2024-03-09T18:47:04,310 Found index url https://pypi.org/simple/ 2024-03-09T18:47:04,531 Fetched page https://pypi.org/simple/ochat/ as application/vnd.pypi.simple.v1+json 2024-03-09T18:47:04,535 Skipping link: No binaries permitted for ochat: https://files.pythonhosted.org/packages/fe/b4/808ac7c8de6ce5f4bb096d0665754d353c268d50e8d1fc60c333fa9a3fa2/ochat-3.1.0-py3-none-any.whl (from https://pypi.org/simple/ochat/) (requires-python:>=3.8) 2024-03-09T18:47:04,537 Found link https://files.pythonhosted.org/packages/c3/ff/7af1c9ee4ff64a55a6484f7bda69978c1f918e70eaa7a7bc0806b3c4fe78/ochat-3.1.0.tar.gz (from https://pypi.org/simple/ochat/) (requires-python:>=3.8), version: 3.1.0 2024-03-09T18:47:04,537 Skipping link: No binaries permitted for ochat: https://files.pythonhosted.org/packages/3e/01/089be44ecc8cc20388c8f4238c7c13e8822d43affe6bda4c6c28998a9c32/ochat-3.1.1-py3-none-any.whl (from https://pypi.org/simple/ochat/) (requires-python:>=3.8) 2024-03-09T18:47:04,538 Found link https://files.pythonhosted.org/packages/72/f1/d9ef664c670b6333933632acbb1eb165a7e970be9572bb6cb740c333cd4a/ochat-3.1.1.tar.gz (from https://pypi.org/simple/ochat/) (requires-python:>=3.8), version: 3.1.1 2024-03-09T18:47:04,539 Skipping link: No binaries permitted for ochat: https://files.pythonhosted.org/packages/65/df/0469097fbeac5ea7a8e57ab5feb561d91cde90f4b85ca66806cfb06caa35/ochat-3.1.2-py3-none-any.whl (from https://pypi.org/simple/ochat/) (requires-python:>=3.8) 2024-03-09T18:47:04,540 Found link https://files.pythonhosted.org/packages/5c/5b/c53e8712f6f3d620b2eff09c9ccc3965a2fbed11d68d9eafdf3f6e0d99f6/ochat-3.1.2.tar.gz (from https://pypi.org/simple/ochat/) (requires-python:>=3.8), version: 3.1.2 2024-03-09T18:47:04,541 Skipping link: No binaries permitted for ochat: https://files.pythonhosted.org/packages/6d/e6/81b4661a87268167347793a90c4f18696dab713d5ac70f13e622eb02e349/ochat-3.2.0-py3-none-any.whl (from https://pypi.org/simple/ochat/) (requires-python:>=3.8) 2024-03-09T18:47:04,542 Found link https://files.pythonhosted.org/packages/74/04/0220df0d03f98c86a86c4ac45555df2c0945f3e4c90271d609830fad59db/ochat-3.2.0.tar.gz (from https://pypi.org/simple/ochat/) (requires-python:>=3.8), version: 3.2.0 2024-03-09T18:47:04,543 Skipping link: No binaries permitted for ochat: https://files.pythonhosted.org/packages/32/50/7b206a868c8b770aef44acb5fbc3ab0d3372c5744495ce9f83879ef147cf/ochat-3.2.1-py3-none-any.whl (from https://pypi.org/simple/ochat/) (requires-python:>=3.8) 2024-03-09T18:47:04,544 Found link https://files.pythonhosted.org/packages/8c/3e/deb412871d042a507d6b21468e8d3eebbf4359f51840fab4d52a4157709d/ochat-3.2.1.tar.gz (from https://pypi.org/simple/ochat/) (requires-python:>=3.8), version: 3.2.1 2024-03-09T18:47:04,545 Skipping link: No binaries permitted for ochat: https://files.pythonhosted.org/packages/7b/6d/0839b59c99acb15b831970e4d6413c0431303c05fdad22cda6eec2312b84/ochat-3.2.2-py3-none-any.whl (from https://pypi.org/simple/ochat/) (requires-python:>=3.8) 2024-03-09T18:47:04,547 Found link https://files.pythonhosted.org/packages/d1/9a/857acfffc3a11191bda354cc898c40c73eae6e91f34393386eb2c9463598/ochat-3.2.2.tar.gz (from https://pypi.org/simple/ochat/) (requires-python:>=3.8), version: 3.2.2 2024-03-09T18:47:04,548 Skipping link: No binaries permitted for ochat: https://files.pythonhosted.org/packages/f3/46/048120288fcca3bab0be06c44e510bef1e7cd95e68719345e5c028e7e708/ochat-3.5.0-py3-none-any.whl (from https://pypi.org/simple/ochat/) (requires-python:>=3.8) 2024-03-09T18:47:04,550 Found link https://files.pythonhosted.org/packages/b5/7a/b68d3272ddea758835994813b161fdf5308f7306eb9ed7a72a42d8769be5/ochat-3.5.0.tar.gz (from https://pypi.org/simple/ochat/) (requires-python:>=3.8), version: 3.5.0 2024-03-09T18:47:04,550 Skipping link: No binaries permitted for ochat: https://files.pythonhosted.org/packages/7c/1a/19df2691335098b98194c56816f3d2e28dd670145658f355acce5a426d7c/ochat-3.5.1-py3-none-any.whl (from https://pypi.org/simple/ochat/) (requires-python:>=3.8) 2024-03-09T18:47:04,551 Found link https://files.pythonhosted.org/packages/8f/08/5d39d3b3fb012c2da4029043b4a39a94936c9bf6589e3070c0e124c23b02/ochat-3.5.1.tar.gz (from https://pypi.org/simple/ochat/) (requires-python:>=3.8), version: 3.5.1 2024-03-09T18:47:04,552 Skipping link: No binaries permitted for ochat: https://files.pythonhosted.org/packages/a8/9c/ba07326de3b50e0e1862371e9861e74b98398b30ad8fc3c3c633491a4935/ochat-3.5.2-py3-none-any.whl (from https://pypi.org/simple/ochat/) (requires-python:>=3.8) 2024-03-09T18:47:04,553 Found link https://files.pythonhosted.org/packages/85/f2/c2a9e4697a4984e2764211c67bf755ce629a85809091bcfa80b515599681/ochat-3.5.2.tar.gz (from https://pypi.org/simple/ochat/) (requires-python:>=3.8), version: 3.5.2 2024-03-09T18:47:04,554 Fetching project page and analyzing links: https://www.piwheels.org/simple/ochat/ 2024-03-09T18:47:04,554 Getting page https://www.piwheels.org/simple/ochat/ 2024-03-09T18:47:04,556 Found index url https://www.piwheels.org/simple/ 2024-03-09T18:47:05,148 Fetched page https://www.piwheels.org/simple/ochat/ as text/html 2024-03-09T18:47:05,155 Skipping link: No binaries permitted for ochat: https://www.piwheels.org/simple/ochat/ochat-3.5.1-py3-none-any.whl#sha256=62fd299acc0648741d808f4cdcaa7dd2fc2c087881feb3cf9701f3506c8cd2c8 (from https://www.piwheels.org/simple/ochat/) (requires-python:>=3.8) 2024-03-09T18:47:05,156 Skipping link: No binaries permitted for ochat: https://www.piwheels.org/simple/ochat/ochat-3.5.0-py3-none-any.whl#sha256=51cb913692c5b18614a975f9f3a13c4ec5170948e9f8a965d096dffb5711b52f (from https://www.piwheels.org/simple/ochat/) (requires-python:>=3.8) 2024-03-09T18:47:05,157 Skipping link: No binaries permitted for ochat: https://www.piwheels.org/simple/ochat/ochat-3.2.2-py3-none-any.whl#sha256=82f9cdb40e4eb6049bed1cd4d956e9d08c6c9e14e59dbc626aa0ffbf3b2d4ab4 (from https://www.piwheels.org/simple/ochat/) (requires-python:>=3.8) 2024-03-09T18:47:05,157 Skipping link: No binaries permitted for ochat: https://www.piwheels.org/simple/ochat/ochat-3.2.1-py3-none-any.whl#sha256=c48f21bb9588ce97ac1bb10674a44591b195f66c78b4df03c9cdd1734d82bf7f (from https://www.piwheels.org/simple/ochat/) (requires-python:>=3.8) 2024-03-09T18:47:05,158 Skipping link: No binaries permitted for ochat: https://www.piwheels.org/simple/ochat/ochat-3.2.0-py3-none-any.whl#sha256=c6bef90573e69ac2e3a05617e2e797c6995eb50ab66a10ab776bb4ef1735f0c3 (from https://www.piwheels.org/simple/ochat/) (requires-python:>=3.8) 2024-03-09T18:47:05,159 Skipping link: No binaries permitted for ochat: https://www.piwheels.org/simple/ochat/ochat-3.1.2-py3-none-any.whl#sha256=c699b340bcb856dd84c9b7825e26e7c3f1369021aed89ff7a92f5c2e983128c2 (from https://www.piwheels.org/simple/ochat/) (requires-python:>=3.8) 2024-03-09T18:47:05,160 Skipping link: No binaries permitted for ochat: https://www.piwheels.org/simple/ochat/ochat-3.1.1-py3-none-any.whl#sha256=4a43888d33ed6df656ed57e25d82f4769173a3bbd1603437e18d5d0e89296224 (from https://www.piwheels.org/simple/ochat/) (requires-python:>=3.8) 2024-03-09T18:47:05,161 Skipping link: No binaries permitted for ochat: https://www.piwheels.org/simple/ochat/ochat-3.1.0-py3-none-any.whl#sha256=bb03bf5cf02d51e5590efb243ad814ab65184e83c240bb44237cfeff74a0bdeb (from https://www.piwheels.org/simple/ochat/) (requires-python:>=3.8) 2024-03-09T18:47:05,162 Skipping link: not a file: https://www.piwheels.org/simple/ochat/ 2024-03-09T18:47:05,163 Skipping link: not a file: https://pypi.org/simple/ochat/ 2024-03-09T18:47:05,203 Given no hashes to check 1 links for project 'ochat': discarding no candidates 2024-03-09T18:47:05,240 Collecting ochat==3.5.2 2024-03-09T18:47:05,243 Created temporary directory: /tmp/pip-unpack-hqgkhcte 2024-03-09T18:47:05,514 Downloading ochat-3.5.2.tar.gz (8.4 MB) 2024-03-09T18:47:13,715 Added ochat==3.5.2 from https://files.pythonhosted.org/packages/85/f2/c2a9e4697a4984e2764211c67bf755ce629a85809091bcfa80b515599681/ochat-3.5.2.tar.gz to build tracker '/tmp/pip-build-tracker-j50l8eut' 2024-03-09T18:47:13,721 Created temporary directory: /tmp/pip-build-env-myl_h4ww 2024-03-09T18:47:13,727 Installing build dependencies: started 2024-03-09T18:47:13,728 Running command pip subprocess to install build dependencies 2024-03-09T18:47:14,926 Using pip 24.0 from /usr/local/lib/python3.11/dist-packages/pip (python 3.11) 2024-03-09T18:47:15,459 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-03-09T18:47:16,921 Collecting setuptools>=45 2024-03-09T18:47:16,939 Using cached https://www.piwheels.org/simple/setuptools/setuptools-69.1.1-py3-none-any.whl (819 kB) 2024-03-09T18:47:17,249 Collecting setuptools_scm>=6.2 (from setuptools_scm[toml]>=6.2) 2024-03-09T18:47:17,374 Using cached https://www.piwheels.org/simple/setuptools-scm/setuptools_scm-8.0.4-py3-none-any.whl (42 kB) 2024-03-09T18:47:17,715 Collecting packaging>=20 (from setuptools_scm>=6.2->setuptools_scm[toml]>=6.2) 2024-03-09T18:47:17,730 Using cached https://www.piwheels.org/simple/packaging/packaging-23.2-py3-none-any.whl (53 kB) 2024-03-09T18:47:17,850 Collecting typing-extensions (from setuptools_scm>=6.2->setuptools_scm[toml]>=6.2) 2024-03-09T18:47:17,867 Using cached https://www.piwheels.org/simple/typing-extensions/typing_extensions-4.10.0-py3-none-any.whl (33 kB) 2024-03-09T18:47:20,438 Installing collected packages: typing-extensions, setuptools, packaging, setuptools_scm 2024-03-09T18:47:23,892 Successfully installed packaging-23.2 setuptools-69.1.1 setuptools_scm-8.0.4 typing-extensions-4.10.0 2024-03-09T18:47:24,484 Installing build dependencies: finished with status 'done' 2024-03-09T18:47:24,487 Getting requirements to build wheel: started 2024-03-09T18:47:24,489 Running command Getting requirements to build wheel 2024-03-09T18:47:25,406 running egg_info 2024-03-09T18:47:25,411 writing ochat.egg-info/PKG-INFO 2024-03-09T18:47:25,416 writing dependency_links to ochat.egg-info/dependency_links.txt 2024-03-09T18:47:25,419 writing requirements to ochat.egg-info/requires.txt 2024-03-09T18:47:25,421 writing top-level names to ochat.egg-info/top_level.txt 2024-03-09T18:47:25,483 ERROR setuptools_scm._file_finders.git listing git files failed - pretending there aren't any 2024-03-09T18:47:25,486 reading manifest file 'ochat.egg-info/SOURCES.txt' 2024-03-09T18:47:25,494 adding license file 'LICENSE' 2024-03-09T18:47:25,501 writing manifest file 'ochat.egg-info/SOURCES.txt' 2024-03-09T18:47:25,620 Getting requirements to build wheel: finished with status 'done' 2024-03-09T18:47:25,632 Installing backend dependencies: started 2024-03-09T18:47:25,633 Running command pip subprocess to install backend dependencies 2024-03-09T18:47:26,812 Using pip 24.0 from /usr/local/lib/python3.11/dist-packages/pip (python 3.11) 2024-03-09T18:47:27,351 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-03-09T18:47:27,871 Collecting wheel 2024-03-09T18:47:27,886 Using cached https://www.piwheels.org/simple/wheel/wheel-0.42.0-py3-none-any.whl (65 kB) 2024-03-09T18:47:30,370 Installing collected packages: wheel 2024-03-09T18:47:30,618 Creating /tmp/pip-build-env-myl_h4ww/normal/local/bin 2024-03-09T18:47:30,621 changing mode of /tmp/pip-build-env-myl_h4ww/normal/local/bin/wheel to 755 2024-03-09T18:47:30,637 Successfully installed wheel-0.42.0 2024-03-09T18:47:31,167 Installing backend dependencies: finished with status 'done' 2024-03-09T18:47:31,169 Created temporary directory: /tmp/pip-modern-metadata-tthx8ttt 2024-03-09T18:47:31,171 Preparing metadata (pyproject.toml): started 2024-03-09T18:47:31,173 Running command Preparing metadata (pyproject.toml) 2024-03-09T18:47:32,125 running dist_info 2024-03-09T18:47:32,132 creating /tmp/pip-modern-metadata-tthx8ttt/ochat.egg-info 2024-03-09T18:47:32,137 writing /tmp/pip-modern-metadata-tthx8ttt/ochat.egg-info/PKG-INFO 2024-03-09T18:47:32,143 writing dependency_links to /tmp/pip-modern-metadata-tthx8ttt/ochat.egg-info/dependency_links.txt 2024-03-09T18:47:32,145 writing requirements to /tmp/pip-modern-metadata-tthx8ttt/ochat.egg-info/requires.txt 2024-03-09T18:47:32,146 writing top-level names to /tmp/pip-modern-metadata-tthx8ttt/ochat.egg-info/top_level.txt 2024-03-09T18:47:32,148 writing manifest file '/tmp/pip-modern-metadata-tthx8ttt/ochat.egg-info/SOURCES.txt' 2024-03-09T18:47:32,203 ERROR setuptools_scm._file_finders.git listing git files failed - pretending there aren't any 2024-03-09T18:47:32,207 reading manifest file '/tmp/pip-modern-metadata-tthx8ttt/ochat.egg-info/SOURCES.txt' 2024-03-09T18:47:32,209 adding license file 'LICENSE' 2024-03-09T18:47:32,212 writing manifest file '/tmp/pip-modern-metadata-tthx8ttt/ochat.egg-info/SOURCES.txt' 2024-03-09T18:47:32,213 creating '/tmp/pip-modern-metadata-tthx8ttt/ochat-3.5.2.dist-info' 2024-03-09T18:47:32,374 Preparing metadata (pyproject.toml): finished with status 'done' 2024-03-09T18:47:32,381 Source in /tmp/pip-wheel-5jloo0ez/ochat_387f19bab6544fdbb8317d3550a6c70c has version 3.5.2, which satisfies requirement ochat==3.5.2 from https://files.pythonhosted.org/packages/85/f2/c2a9e4697a4984e2764211c67bf755ce629a85809091bcfa80b515599681/ochat-3.5.2.tar.gz 2024-03-09T18:47:32,382 Removed ochat==3.5.2 from https://files.pythonhosted.org/packages/85/f2/c2a9e4697a4984e2764211c67bf755ce629a85809091bcfa80b515599681/ochat-3.5.2.tar.gz from build tracker '/tmp/pip-build-tracker-j50l8eut' 2024-03-09T18:47:32,391 Created temporary directory: /tmp/pip-unpack-lqrwbcez 2024-03-09T18:47:32,392 Created temporary directory: /tmp/pip-unpack-2qgikila 2024-03-09T18:47:32,418 Building wheels for collected packages: ochat 2024-03-09T18:47:32,423 Created temporary directory: /tmp/pip-wheel-27v2wb3r 2024-03-09T18:47:32,423 Destination directory: /tmp/pip-wheel-27v2wb3r 2024-03-09T18:47:32,425 Building wheel for ochat (pyproject.toml): started 2024-03-09T18:47:32,427 Running command Building wheel for ochat (pyproject.toml) 2024-03-09T18:47:33,297 running bdist_wheel 2024-03-09T18:47:33,321 running build 2024-03-09T18:47:33,322 running build_py 2024-03-09T18:47:33,327 creating build 2024-03-09T18:47:33,328 creating build/lib 2024-03-09T18:47:33,329 creating build/lib/ochat 2024-03-09T18:47:33,330 copying ochat/__init__.py -> build/lib/ochat 2024-03-09T18:47:33,333 creating build/lib/ochat/evaluation 2024-03-09T18:47:33,334 copying ochat/evaluation/match_answer.py -> build/lib/ochat/evaluation 2024-03-09T18:47:33,336 copying ochat/evaluation/convert_to_evalplus.py -> build/lib/ochat/evaluation 2024-03-09T18:47:33,338 copying ochat/evaluation/conv_eval.py -> build/lib/ochat/evaluation 2024-03-09T18:47:33,341 copying ochat/evaluation/run_eval.py -> build/lib/ochat/evaluation 2024-03-09T18:47:33,344 copying ochat/evaluation/view_results.py -> build/lib/ochat/evaluation 2024-03-09T18:47:33,347 creating build/lib/ochat/scripts 2024-03-09T18:47:33,348 copying ochat/scripts/modify_eos_embedding.py -> build/lib/ochat/scripts 2024-03-09T18:47:33,350 copying ochat/scripts/hf_add_tokens.py -> build/lib/ochat/scripts 2024-03-09T18:47:33,353 creating build/lib/ochat/config 2024-03-09T18:47:33,354 copying ochat/config/conversation_template.py -> build/lib/ochat/config 2024-03-09T18:47:33,356 copying ochat/config/model_config.py -> build/lib/ochat/config 2024-03-09T18:47:33,358 copying ochat/config/__init__.py -> build/lib/ochat/config 2024-03-09T18:47:33,360 creating build/lib/ochat/training_deepspeed 2024-03-09T18:47:33,361 copying ochat/training_deepspeed/openchat_dataset.py -> build/lib/ochat/training_deepspeed 2024-03-09T18:47:33,363 copying ochat/training_deepspeed/multipack_sampler.py -> build/lib/ochat/training_deepspeed 2024-03-09T18:47:33,365 copying ochat/training_deepspeed/train.py -> build/lib/ochat/training_deepspeed 2024-03-09T18:47:33,368 creating build/lib/ochat/tests 2024-03-09T18:47:33,369 copying ochat/tests/test_model_config.py -> build/lib/ochat/tests 2024-03-09T18:47:33,372 creating build/lib/ochat/experimental 2024-03-09T18:47:33,373 copying ochat/experimental/train_alpaca.py -> build/lib/ochat/experimental 2024-03-09T18:47:33,375 copying ochat/experimental/generate_dataset_old.py -> build/lib/ochat/experimental 2024-03-09T18:47:33,378 creating build/lib/ochat/models 2024-03-09T18:47:33,379 copying ochat/models/__init__.py -> build/lib/ochat/models 2024-03-09T18:47:33,381 copying ochat/models/unpadded_gemma.py -> build/lib/ochat/models 2024-03-09T18:47:33,384 copying ochat/models/unpadded_llama.py -> build/lib/ochat/models 2024-03-09T18:47:33,386 copying ochat/models/unpadded_mistral.py -> build/lib/ochat/models 2024-03-09T18:47:33,389 creating build/lib/ochat/data 2024-03-09T18:47:33,390 copying ochat/data/generate_dataset.py -> build/lib/ochat/data 2024-03-09T18:47:33,394 creating build/lib/ochat/serving 2024-03-09T18:47:33,395 copying ochat/serving/async_tokenizer.py -> build/lib/ochat/serving 2024-03-09T18:47:33,397 copying ochat/serving/openai_api_protocol.py -> build/lib/ochat/serving 2024-03-09T18:47:33,399 copying ochat/serving/openai_api_server.py -> build/lib/ochat/serving 2024-03-09T18:47:33,403 creating build/lib/ochat/evaluation/grading 2024-03-09T18:47:33,404 copying ochat/evaluation/grading/math_grader.py -> build/lib/ochat/evaluation/grading 2024-03-09T18:47:33,407 copying ochat/evaluation/grading/math_normalize.py -> build/lib/ochat/evaluation/grading 2024-03-09T18:47:33,414 running egg_info 2024-03-09T18:47:33,419 writing ochat.egg-info/PKG-INFO 2024-03-09T18:47:33,423 writing dependency_links to ochat.egg-info/dependency_links.txt 2024-03-09T18:47:33,425 writing requirements to ochat.egg-info/requires.txt 2024-03-09T18:47:33,426 writing top-level names to ochat.egg-info/top_level.txt 2024-03-09T18:47:33,470 ERROR setuptools_scm._file_finders.git listing git files failed - pretending there aren't any 2024-03-09T18:47:33,473 reading manifest file 'ochat.egg-info/SOURCES.txt' 2024-03-09T18:47:33,498 adding license file 'LICENSE' 2024-03-09T18:47:33,505 writing manifest file 'ochat.egg-info/SOURCES.txt' 2024-03-09T18:47:33,523 copying ochat/evaluation/README.md -> build/lib/ochat/evaluation 2024-03-09T18:47:33,525 copying ochat/training_deepspeed/deepspeed_config.json -> build/lib/ochat/training_deepspeed 2024-03-09T18:47:33,528 copying ochat/experimental/sharegpt.ipynb -> build/lib/ochat/experimental 2024-03-09T18:47:33,534 copying ochat/experimental/test_multipack_dataloader.ipynb -> build/lib/ochat/experimental 2024-03-09T18:47:33,537 copying ochat/experimental/text_length.ipynb -> build/lib/ochat/experimental 2024-03-09T18:47:33,540 copying ochat/experimental/verify_dataset.ipynb -> build/lib/ochat/experimental 2024-03-09T18:47:33,543 copying ochat/experimental/verify_dataset_orca.ipynb -> build/lib/ochat/experimental 2024-03-09T18:47:33,546 creating build/lib/ochat/evaluation/eval_data 2024-03-09T18:47:33,547 creating build/lib/ochat/evaluation/eval_data/fs_cothub 2024-03-09T18:47:33,548 creating build/lib/ochat/evaluation/eval_data/fs_cothub/gsm8k 2024-03-09T18:47:33,549 copying ochat/evaluation/eval_data/fs_cothub/gsm8k/gsm8k.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/gsm8k 2024-03-09T18:47:33,955 creating build/lib/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:33,956 copying ochat/evaluation/eval_data/fs_cothub/bbh/boolean_expressions.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:33,970 copying ochat/evaluation/eval_data/fs_cothub/bbh/causal_judgement.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:34,032 copying ochat/evaluation/eval_data/fs_cothub/bbh/date_understanding.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:34,042 copying ochat/evaluation/eval_data/fs_cothub/bbh/disambiguation_qa.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:34,088 copying ochat/evaluation/eval_data/fs_cothub/bbh/dyck_languages.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:34,113 copying ochat/evaluation/eval_data/fs_cothub/bbh/formal_fallacies.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:34,173 copying ochat/evaluation/eval_data/fs_cothub/bbh/geometric_shapes.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:34,227 copying ochat/evaluation/eval_data/fs_cothub/bbh/hyperbaton.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:34,249 copying ochat/evaluation/eval_data/fs_cothub/bbh/logical_deduction_five_objects.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:34,270 copying ochat/evaluation/eval_data/fs_cothub/bbh/logical_deduction_seven_objects.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:34,309 copying ochat/evaluation/eval_data/fs_cothub/bbh/logical_deduction_three_objects.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:34,337 copying ochat/evaluation/eval_data/fs_cothub/bbh/movie_recommendation.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:34,365 copying ochat/evaluation/eval_data/fs_cothub/bbh/multistep_arithmetic_two.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:34,389 copying ochat/evaluation/eval_data/fs_cothub/bbh/navigate.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:34,407 copying ochat/evaluation/eval_data/fs_cothub/bbh/object_counting.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:34,423 copying ochat/evaluation/eval_data/fs_cothub/bbh/penguins_in_a_table.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:34,441 copying ochat/evaluation/eval_data/fs_cothub/bbh/reasoning_about_colored_objects.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:34,495 copying ochat/evaluation/eval_data/fs_cothub/bbh/ruin_names.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:34,544 copying ochat/evaluation/eval_data/fs_cothub/bbh/salient_translation_error_detection.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:34,941 copying ochat/evaluation/eval_data/fs_cothub/bbh/snarks.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:35,000 copying ochat/evaluation/eval_data/fs_cothub/bbh/sports_understanding.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:35,009 copying ochat/evaluation/eval_data/fs_cothub/bbh/temporal_sequences.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:35,032 copying ochat/evaluation/eval_data/fs_cothub/bbh/tracking_shuffled_objects_five_objects.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:35,052 copying ochat/evaluation/eval_data/fs_cothub/bbh/tracking_shuffled_objects_seven_objects.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:35,126 copying ochat/evaluation/eval_data/fs_cothub/bbh/tracking_shuffled_objects_three_objects.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:35,167 copying ochat/evaluation/eval_data/fs_cothub/bbh/web_of_lies.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:35,199 copying ochat/evaluation/eval_data/fs_cothub/bbh/word_sorting.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:35,242 creating build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:35,243 copying ochat/evaluation/eval_data/fs_cothub/mmlu/abstract_algebra.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:35,257 copying ochat/evaluation/eval_data/fs_cothub/mmlu/anatomy.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:35,285 copying ochat/evaluation/eval_data/fs_cothub/mmlu/astronomy.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:35,304 copying ochat/evaluation/eval_data/fs_cothub/mmlu/business_ethics.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:35,322 copying ochat/evaluation/eval_data/fs_cothub/mmlu/clinical_knowledge.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:35,348 copying ochat/evaluation/eval_data/fs_cothub/mmlu/college_biology.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:35,394 copying ochat/evaluation/eval_data/fs_cothub/mmlu/college_chemistry.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:35,405 copying ochat/evaluation/eval_data/fs_cothub/mmlu/college_computer_science.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:35,429 copying ochat/evaluation/eval_data/fs_cothub/mmlu/college_mathematics.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:35,447 copying ochat/evaluation/eval_data/fs_cothub/mmlu/college_medicine.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:35,476 copying ochat/evaluation/eval_data/fs_cothub/mmlu/college_physics.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:35,489 copying ochat/evaluation/eval_data/fs_cothub/mmlu/computer_security.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:35,503 copying ochat/evaluation/eval_data/fs_cothub/mmlu/conceptual_physics.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:35,518 copying ochat/evaluation/eval_data/fs_cothub/mmlu/econometrics.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:35,539 copying ochat/evaluation/eval_data/fs_cothub/mmlu/electrical_engineering.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:35,550 copying ochat/evaluation/eval_data/fs_cothub/mmlu/elementary_mathematics.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:35,586 copying ochat/evaluation/eval_data/fs_cothub/mmlu/formal_logic.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:35,611 copying ochat/evaluation/eval_data/fs_cothub/mmlu/global_facts.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:35,621 copying ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_biology.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:35,666 copying ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_chemistry.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:35,742 copying ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_computer_science.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:35,759 copying ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_european_history.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:35,839 copying ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_geography.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:35,856 copying ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_government_and_politics.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:35,883 copying ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_macroeconomics.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:35,922 copying ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_mathematics.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:36,023 copying ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_microeconomics.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:36,048 copying ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_physics.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:36,066 copying ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_psychology.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:36,354 copying ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_statistics.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:36,396 copying ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_us_history.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:36,481 copying ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_world_history.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:36,528 copying ochat/evaluation/eval_data/fs_cothub/mmlu/human_aging.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:36,544 copying ochat/evaluation/eval_data/fs_cothub/mmlu/human_sexuality.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:36,558 copying ochat/evaluation/eval_data/fs_cothub/mmlu/international_law.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:36,572 copying ochat/evaluation/eval_data/fs_cothub/mmlu/jurisprudence.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:36,583 copying ochat/evaluation/eval_data/fs_cothub/mmlu/logical_fallacies.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:36,635 copying ochat/evaluation/eval_data/fs_cothub/mmlu/machine_learning.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:36,660 copying ochat/evaluation/eval_data/fs_cothub/mmlu/management.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:36,669 copying ochat/evaluation/eval_data/fs_cothub/mmlu/marketing.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:36,688 copying ochat/evaluation/eval_data/fs_cothub/mmlu/medical_genetics.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:36,702 copying ochat/evaluation/eval_data/fs_cothub/mmlu/miscellaneous.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:36,793 copying ochat/evaluation/eval_data/fs_cothub/mmlu/moral_disputes.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:36,839 copying ochat/evaluation/eval_data/fs_cothub/mmlu/moral_scenarios.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:36,957 copying ochat/evaluation/eval_data/fs_cothub/mmlu/nutrition.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:37,033 copying ochat/evaluation/eval_data/fs_cothub/mmlu/philosophy.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:37,059 copying ochat/evaluation/eval_data/fs_cothub/mmlu/prehistory.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:37,087 copying ochat/evaluation/eval_data/fs_cothub/mmlu/professional_accounting.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:37,119 copying ochat/evaluation/eval_data/fs_cothub/mmlu/professional_law.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:37,803 copying ochat/evaluation/eval_data/fs_cothub/mmlu/professional_medicine.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:37,905 copying ochat/evaluation/eval_data/fs_cothub/mmlu/professional_psychology.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:38,045 copying ochat/evaluation/eval_data/fs_cothub/mmlu/public_relations.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:38,062 copying ochat/evaluation/eval_data/fs_cothub/mmlu/security_studies.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:38,117 copying ochat/evaluation/eval_data/fs_cothub/mmlu/sociology.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:38,140 copying ochat/evaluation/eval_data/fs_cothub/mmlu/us_foreign_policy.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:38,153 copying ochat/evaluation/eval_data/fs_cothub/mmlu/virology.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:38,170 copying ochat/evaluation/eval_data/fs_cothub/mmlu/world_religions.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:38,182 creating build/lib/ochat/evaluation/eval_data/coding 2024-03-09T18:47:38,183 creating build/lib/ochat/evaluation/eval_data/coding/humaneval 2024-03-09T18:47:38,184 copying ochat/evaluation/eval_data/coding/humaneval/humaneval.jsonl -> build/lib/ochat/evaluation/eval_data/coding/humaneval 2024-03-09T18:47:38,569 creating build/lib/ochat/evaluation/eval_data/zs 2024-03-09T18:47:38,570 creating build/lib/ochat/evaluation/eval_data/zs/truthfulqa_orca 2024-03-09T18:47:38,571 copying ochat/evaluation/eval_data/zs/truthfulqa_orca/truthfulqa_mc.jsonl -> build/lib/ochat/evaluation/eval_data/zs/truthfulqa_orca 2024-03-09T18:47:38,582 creating build/lib/ochat/evaluation/eval_data/zs/agieval 2024-03-09T18:47:38,583 copying ochat/evaluation/eval_data/zs/agieval/aqua-rat.zero-shot.jsonl -> build/lib/ochat/evaluation/eval_data/zs/agieval 2024-03-09T18:47:38,681 copying ochat/evaluation/eval_data/zs/agieval/logiqa-en.zero-shot.jsonl -> build/lib/ochat/evaluation/eval_data/zs/agieval 2024-03-09T18:47:38,705 copying ochat/evaluation/eval_data/zs/agieval/lsat-ar.zero-shot.jsonl -> build/lib/ochat/evaluation/eval_data/zs/agieval 2024-03-09T18:47:38,717 copying ochat/evaluation/eval_data/zs/agieval/lsat-lr.zero-shot.jsonl -> build/lib/ochat/evaluation/eval_data/zs/agieval 2024-03-09T18:47:38,746 copying ochat/evaluation/eval_data/zs/agieval/lsat-rc.zero-shot.jsonl -> build/lib/ochat/evaluation/eval_data/zs/agieval 2024-03-09T18:47:38,782 copying ochat/evaluation/eval_data/zs/agieval/sat-en-without-passage.zero-shot.jsonl -> build/lib/ochat/evaluation/eval_data/zs/agieval 2024-03-09T18:47:38,791 copying ochat/evaluation/eval_data/zs/agieval/sat-en.zero-shot.jsonl -> build/lib/ochat/evaluation/eval_data/zs/agieval 2024-03-09T18:47:38,820 copying ochat/evaluation/eval_data/zs/agieval/sat-math.zero-shot.jsonl -> build/lib/ochat/evaluation/eval_data/zs/agieval 2024-03-09T18:47:38,825 creating build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:38,827 copying ochat/evaluation/eval_data/zs/bbh_mc_orca/boolean_expressions.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:38,831 copying ochat/evaluation/eval_data/zs/bbh_mc_orca/causal_judgment.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:38,839 copying ochat/evaluation/eval_data/zs/bbh_mc_orca/date_understanding.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:38,845 copying ochat/evaluation/eval_data/zs/bbh_mc_orca/disambiguation_qa.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:38,850 copying ochat/evaluation/eval_data/zs/bbh_mc_orca/formal_fallacies_syllogisms_negation.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:38,905 copying ochat/evaluation/eval_data/zs/bbh_mc_orca/geometric_shapes.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:38,912 copying ochat/evaluation/eval_data/zs/bbh_mc_orca/hyperbaton.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:38,918 copying ochat/evaluation/eval_data/zs/bbh_mc_orca/logical_deduction_five_objects.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:38,930 copying ochat/evaluation/eval_data/zs/bbh_mc_orca/logical_deduction_seven_objects.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:38,943 copying ochat/evaluation/eval_data/zs/bbh_mc_orca/logical_deduction_three_objects.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:38,953 copying ochat/evaluation/eval_data/zs/bbh_mc_orca/movie_recommendation.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:38,959 copying ochat/evaluation/eval_data/zs/bbh_mc_orca/navigate.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:38,969 copying ochat/evaluation/eval_data/zs/bbh_mc_orca/penguins_in_a_table.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:38,975 copying ochat/evaluation/eval_data/zs/bbh_mc_orca/reasoning_about_colored_objects.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:38,985 copying ochat/evaluation/eval_data/zs/bbh_mc_orca/ruin_names.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:38,992 copying ochat/evaluation/eval_data/zs/bbh_mc_orca/salient_translation_error_detection.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:39,011 copying ochat/evaluation/eval_data/zs/bbh_mc_orca/snarks.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:39,018 copying ochat/evaluation/eval_data/zs/bbh_mc_orca/sports_understanding.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:39,028 copying ochat/evaluation/eval_data/zs/bbh_mc_orca/temporal_sequences.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:39,040 copying ochat/evaluation/eval_data/zs/bbh_mc_orca/tracking_shuffled_objects_five_objects.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:39,051 copying ochat/evaluation/eval_data/zs/bbh_mc_orca/tracking_shuffled_objects_seven_objects.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:39,065 copying ochat/evaluation/eval_data/zs/bbh_mc_orca/tracking_shuffled_objects_three_objects.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:39,113 copying ochat/evaluation/eval_data/zs/bbh_mc_orca/web_of_lies.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:39,118 creating build/lib/ochat/evaluation/eval_data/zs/math 2024-03-09T18:47:39,120 copying ochat/evaluation/eval_data/zs/math/MATH.jsonl -> build/lib/ochat/evaluation/eval_data/zs/math 2024-03-09T18:47:39,403 installing to build/bdist.linux-armv7l/wheel 2024-03-09T18:47:39,403 running install 2024-03-09T18:47:39,428 running install_lib 2024-03-09T18:47:39,435 creating build/bdist.linux-armv7l 2024-03-09T18:47:39,436 creating build/bdist.linux-armv7l/wheel 2024-03-09T18:47:39,438 creating build/bdist.linux-armv7l/wheel/ochat 2024-03-09T18:47:39,440 creating build/bdist.linux-armv7l/wheel/ochat/evaluation 2024-03-09T18:47:39,442 creating build/bdist.linux-armv7l/wheel/ochat/evaluation/grading 2024-03-09T18:47:39,443 copying build/lib/ochat/evaluation/grading/math_grader.py -> build/bdist.linux-armv7l/wheel/ochat/evaluation/grading 2024-03-09T18:47:39,446 copying build/lib/ochat/evaluation/grading/math_normalize.py -> build/bdist.linux-armv7l/wheel/ochat/evaluation/grading 2024-03-09T18:47:39,449 copying build/lib/ochat/evaluation/match_answer.py -> build/bdist.linux-armv7l/wheel/ochat/evaluation 2024-03-09T18:47:39,452 copying build/lib/ochat/evaluation/convert_to_evalplus.py -> build/bdist.linux-armv7l/wheel/ochat/evaluation 2024-03-09T18:47:39,455 copying build/lib/ochat/evaluation/conv_eval.py -> build/bdist.linux-armv7l/wheel/ochat/evaluation 2024-03-09T18:47:39,458 copying build/lib/ochat/evaluation/README.md -> build/bdist.linux-armv7l/wheel/ochat/evaluation 2024-03-09T18:47:39,460 copying build/lib/ochat/evaluation/run_eval.py -> build/bdist.linux-armv7l/wheel/ochat/evaluation 2024-03-09T18:47:39,463 copying build/lib/ochat/evaluation/view_results.py -> build/bdist.linux-armv7l/wheel/ochat/evaluation 2024-03-09T18:47:39,467 creating build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data 2024-03-09T18:47:39,469 creating build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub 2024-03-09T18:47:39,472 creating build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/gsm8k 2024-03-09T18:47:39,474 copying build/lib/ochat/evaluation/eval_data/fs_cothub/gsm8k/gsm8k.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/gsm8k 2024-03-09T18:47:39,947 creating build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:39,949 copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/causal_judgement.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:39,987 copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/sports_understanding.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:40,003 copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/date_understanding.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:40,058 copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/boolean_expressions.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:40,076 copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/tracking_shuffled_objects_five_objects.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:40,129 copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/snarks.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:40,152 copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/reasoning_about_colored_objects.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:40,193 copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/tracking_shuffled_objects_seven_objects.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:40,242 copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/temporal_sequences.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:40,276 copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/ruin_names.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:40,308 copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/multistep_arithmetic_two.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:40,332 copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/formal_fallacies.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:40,369 copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/logical_deduction_seven_objects.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:40,402 copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/hyperbaton.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:40,428 copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/tracking_shuffled_objects_three_objects.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:40,456 copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/disambiguation_qa.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:40,533 copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/salient_translation_error_detection.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:40,582 copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/web_of_lies.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:40,663 copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/logical_deduction_three_objects.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:40,692 copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/movie_recommendation.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:40,742 copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/logical_deduction_five_objects.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:40,775 copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/navigate.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:40,792 copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/geometric_shapes.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:40,912 copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/dyck_languages.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:40,980 copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/word_sorting.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:41,005 copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/object_counting.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:41,018 copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/penguins_in_a_table.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh 2024-03-09T18:47:41,034 creating build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:41,035 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/management.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:41,046 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/college_mathematics.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:41,060 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_macroeconomics.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:41,106 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/prehistory.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:41,183 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/abstract_algebra.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:41,212 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/miscellaneous.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:41,284 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_government_and_politics.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:41,314 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/logical_fallacies.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:41,334 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/us_foreign_policy.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:41,405 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_computer_science.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:41,450 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/econometrics.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:41,496 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_physics.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:41,540 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/anatomy.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:41,566 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/moral_disputes.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:41,610 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/human_aging.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:41,627 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/professional_psychology.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:41,719 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/medical_genetics.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:41,730 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/conceptual_physics.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:41,750 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/public_relations.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:41,761 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/clinical_knowledge.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:41,780 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_microeconomics.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:41,799 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_biology.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:41,835 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_mathematics.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:41,850 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_european_history.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:41,904 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/astronomy.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:41,919 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/marketing.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:41,939 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/electrical_engineering.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:41,951 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/sociology.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:41,969 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_chemistry.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:41,989 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/philosophy.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:42,024 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/world_religions.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:42,035 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/college_chemistry.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:42,045 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/machine_learning.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:42,059 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/virology.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:42,073 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/college_biology.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:42,091 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/elementary_mathematics.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:42,120 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_statistics.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:42,152 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_world_history.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:42,204 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/security_studies.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:42,242 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/nutrition.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:42,270 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_geography.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:42,286 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/business_ethics.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:42,331 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_psychology.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:42,397 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/computer_security.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:42,412 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_us_history.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:42,514 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/formal_logic.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:42,530 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/global_facts.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:42,536 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/professional_law.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:43,025 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/college_computer_science.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:43,042 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/professional_accounting.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:43,092 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/jurisprudence.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:43,103 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/moral_scenarios.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:43,179 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/international_law.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:43,193 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/human_sexuality.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:43,203 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/professional_medicine.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:43,249 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/college_physics.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:43,260 copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/college_medicine.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu 2024-03-09T18:47:43,285 creating build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/coding 2024-03-09T18:47:43,287 creating build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/coding/humaneval 2024-03-09T18:47:43,288 copying build/lib/ochat/evaluation/eval_data/coding/humaneval/humaneval.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/coding/humaneval 2024-03-09T18:47:43,476 creating build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs 2024-03-09T18:47:43,477 creating build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/truthfulqa_orca 2024-03-09T18:47:43,479 copying build/lib/ochat/evaluation/eval_data/zs/truthfulqa_orca/truthfulqa_mc.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/truthfulqa_orca 2024-03-09T18:47:43,487 creating build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/agieval 2024-03-09T18:47:43,488 copying build/lib/ochat/evaluation/eval_data/zs/agieval/sat-en.zero-shot.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/agieval 2024-03-09T18:47:43,509 copying build/lib/ochat/evaluation/eval_data/zs/agieval/logiqa-en.zero-shot.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/agieval 2024-03-09T18:47:43,524 copying build/lib/ochat/evaluation/eval_data/zs/agieval/lsat-lr.zero-shot.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/agieval 2024-03-09T18:47:43,538 copying build/lib/ochat/evaluation/eval_data/zs/agieval/sat-en-without-passage.zero-shot.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/agieval 2024-03-09T18:47:43,543 copying build/lib/ochat/evaluation/eval_data/zs/agieval/lsat-ar.zero-shot.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/agieval 2024-03-09T18:47:43,549 copying build/lib/ochat/evaluation/eval_data/zs/agieval/aqua-rat.zero-shot.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/agieval 2024-03-09T18:47:43,555 copying build/lib/ochat/evaluation/eval_data/zs/agieval/sat-math.zero-shot.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/agieval 2024-03-09T18:47:43,560 copying build/lib/ochat/evaluation/eval_data/zs/agieval/lsat-rc.zero-shot.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/agieval 2024-03-09T18:47:43,624 creating build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:43,626 copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/sports_understanding.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:43,630 copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/date_understanding.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:43,633 copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/boolean_expressions.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:43,637 copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/tracking_shuffled_objects_five_objects.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:43,644 copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/snarks.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:43,648 copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/reasoning_about_colored_objects.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:43,653 copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/tracking_shuffled_objects_seven_objects.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:43,662 copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/temporal_sequences.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:43,667 copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/ruin_names.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:43,671 copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/logical_deduction_seven_objects.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:43,678 copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/hyperbaton.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:43,682 copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/causal_judgment.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:43,692 copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/tracking_shuffled_objects_three_objects.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:43,698 copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/disambiguation_qa.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:43,703 copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/salient_translation_error_detection.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:43,714 copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/web_of_lies.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:43,718 copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/logical_deduction_three_objects.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:43,725 copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/movie_recommendation.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:43,729 copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/logical_deduction_five_objects.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:43,737 copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/navigate.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:43,742 copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/geometric_shapes.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:43,747 copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/formal_fallacies_syllogisms_negation.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:43,753 copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/penguins_in_a_table.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca 2024-03-09T18:47:43,761 creating build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/math 2024-03-09T18:47:43,762 copying build/lib/ochat/evaluation/eval_data/zs/math/MATH.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/math 2024-03-09T18:47:43,933 creating build/bdist.linux-armv7l/wheel/ochat/scripts 2024-03-09T18:47:43,934 copying build/lib/ochat/scripts/modify_eos_embedding.py -> build/bdist.linux-armv7l/wheel/ochat/scripts 2024-03-09T18:47:43,936 copying build/lib/ochat/scripts/hf_add_tokens.py -> build/bdist.linux-armv7l/wheel/ochat/scripts 2024-03-09T18:47:43,938 creating build/bdist.linux-armv7l/wheel/ochat/config 2024-03-09T18:47:43,939 copying build/lib/ochat/config/conversation_template.py -> build/bdist.linux-armv7l/wheel/ochat/config 2024-03-09T18:47:43,941 copying build/lib/ochat/config/model_config.py -> build/bdist.linux-armv7l/wheel/ochat/config 2024-03-09T18:47:43,942 copying build/lib/ochat/config/__init__.py -> build/bdist.linux-armv7l/wheel/ochat/config 2024-03-09T18:47:43,945 creating build/bdist.linux-armv7l/wheel/ochat/training_deepspeed 2024-03-09T18:47:43,946 copying build/lib/ochat/training_deepspeed/deepspeed_config.json -> build/bdist.linux-armv7l/wheel/ochat/training_deepspeed 2024-03-09T18:47:43,948 copying build/lib/ochat/training_deepspeed/openchat_dataset.py -> build/bdist.linux-armv7l/wheel/ochat/training_deepspeed 2024-03-09T18:47:43,950 copying build/lib/ochat/training_deepspeed/multipack_sampler.py -> build/bdist.linux-armv7l/wheel/ochat/training_deepspeed 2024-03-09T18:47:43,952 copying build/lib/ochat/training_deepspeed/train.py -> build/bdist.linux-armv7l/wheel/ochat/training_deepspeed 2024-03-09T18:47:43,955 creating build/bdist.linux-armv7l/wheel/ochat/tests 2024-03-09T18:47:43,955 copying build/lib/ochat/tests/test_model_config.py -> build/bdist.linux-armv7l/wheel/ochat/tests 2024-03-09T18:47:43,958 creating build/bdist.linux-armv7l/wheel/ochat/experimental 2024-03-09T18:47:43,959 copying build/lib/ochat/experimental/train_alpaca.py -> build/bdist.linux-armv7l/wheel/ochat/experimental 2024-03-09T18:47:43,961 copying build/lib/ochat/experimental/verify_dataset_orca.ipynb -> build/bdist.linux-armv7l/wheel/ochat/experimental 2024-03-09T18:47:43,964 copying build/lib/ochat/experimental/generate_dataset_old.py -> build/bdist.linux-armv7l/wheel/ochat/experimental 2024-03-09T18:47:43,966 copying build/lib/ochat/experimental/verify_dataset.ipynb -> build/bdist.linux-armv7l/wheel/ochat/experimental 2024-03-09T18:47:43,971 copying build/lib/ochat/experimental/text_length.ipynb -> build/bdist.linux-armv7l/wheel/ochat/experimental 2024-03-09T18:47:43,973 copying build/lib/ochat/experimental/test_multipack_dataloader.ipynb -> build/bdist.linux-armv7l/wheel/ochat/experimental 2024-03-09T18:47:43,976 copying build/lib/ochat/experimental/sharegpt.ipynb -> build/bdist.linux-armv7l/wheel/ochat/experimental 2024-03-09T18:47:43,979 copying build/lib/ochat/__init__.py -> build/bdist.linux-armv7l/wheel/ochat 2024-03-09T18:47:43,982 creating build/bdist.linux-armv7l/wheel/ochat/models 2024-03-09T18:47:43,983 copying build/lib/ochat/models/__init__.py -> build/bdist.linux-armv7l/wheel/ochat/models 2024-03-09T18:47:43,985 copying build/lib/ochat/models/unpadded_gemma.py -> build/bdist.linux-armv7l/wheel/ochat/models 2024-03-09T18:47:43,987 copying build/lib/ochat/models/unpadded_llama.py -> build/bdist.linux-armv7l/wheel/ochat/models 2024-03-09T18:47:43,990 copying build/lib/ochat/models/unpadded_mistral.py -> build/bdist.linux-armv7l/wheel/ochat/models 2024-03-09T18:47:43,993 creating build/bdist.linux-armv7l/wheel/ochat/data 2024-03-09T18:47:43,995 copying build/lib/ochat/data/generate_dataset.py -> build/bdist.linux-armv7l/wheel/ochat/data 2024-03-09T18:47:43,998 creating build/bdist.linux-armv7l/wheel/ochat/serving 2024-03-09T18:47:43,999 copying build/lib/ochat/serving/async_tokenizer.py -> build/bdist.linux-armv7l/wheel/ochat/serving 2024-03-09T18:47:44,002 copying build/lib/ochat/serving/openai_api_protocol.py -> build/bdist.linux-armv7l/wheel/ochat/serving 2024-03-09T18:47:44,004 copying build/lib/ochat/serving/openai_api_server.py -> build/bdist.linux-armv7l/wheel/ochat/serving 2024-03-09T18:47:44,007 running install_egg_info 2024-03-09T18:47:44,013 Copying ochat.egg-info to build/bdist.linux-armv7l/wheel/ochat-3.5.2-py3.11.egg-info 2024-03-09T18:47:44,024 running install_scripts 2024-03-09T18:47:44,053 creating build/bdist.linux-armv7l/wheel/ochat-3.5.2.dist-info/WHEEL 2024-03-09T18:47:44,056 creating '/tmp/pip-wheel-27v2wb3r/.tmp-zjva7xwx/ochat-3.5.2-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2024-03-09T18:47:44,060 adding 'ochat/__init__.py' 2024-03-09T18:47:44,063 adding 'ochat/config/__init__.py' 2024-03-09T18:47:44,065 adding 'ochat/config/conversation_template.py' 2024-03-09T18:47:44,066 adding 'ochat/config/model_config.py' 2024-03-09T18:47:44,069 adding 'ochat/data/generate_dataset.py' 2024-03-09T18:47:44,071 adding 'ochat/evaluation/README.md' 2024-03-09T18:47:44,074 adding 'ochat/evaluation/conv_eval.py' 2024-03-09T18:47:44,075 adding 'ochat/evaluation/convert_to_evalplus.py' 2024-03-09T18:47:44,078 adding 'ochat/evaluation/match_answer.py' 2024-03-09T18:47:44,080 adding 'ochat/evaluation/run_eval.py' 2024-03-09T18:47:44,083 adding 'ochat/evaluation/view_results.py' 2024-03-09T18:47:44,801 adding 'ochat/evaluation/eval_data/coding/humaneval/humaneval.jsonl' 2024-03-09T18:47:44,865 adding 'ochat/evaluation/eval_data/fs_cothub/bbh/boolean_expressions.jsonl' 2024-03-09T18:47:44,923 adding 'ochat/evaluation/eval_data/fs_cothub/bbh/causal_judgement.jsonl' 2024-03-09T18:47:44,947 adding 'ochat/evaluation/eval_data/fs_cothub/bbh/date_understanding.jsonl' 2024-03-09T18:47:44,981 adding 'ochat/evaluation/eval_data/fs_cothub/bbh/disambiguation_qa.jsonl' 2024-03-09T18:47:45,008 adding 'ochat/evaluation/eval_data/fs_cothub/bbh/dyck_languages.jsonl' 2024-03-09T18:47:45,057 adding 'ochat/evaluation/eval_data/fs_cothub/bbh/formal_fallacies.jsonl' 2024-03-09T18:47:45,102 adding 'ochat/evaluation/eval_data/fs_cothub/bbh/geometric_shapes.jsonl' 2024-03-09T18:47:45,134 adding 'ochat/evaluation/eval_data/fs_cothub/bbh/hyperbaton.jsonl' 2024-03-09T18:47:45,168 adding 'ochat/evaluation/eval_data/fs_cothub/bbh/logical_deduction_five_objects.jsonl' 2024-03-09T18:47:45,205 adding 'ochat/evaluation/eval_data/fs_cothub/bbh/logical_deduction_seven_objects.jsonl' 2024-03-09T18:47:45,235 adding 'ochat/evaluation/eval_data/fs_cothub/bbh/logical_deduction_three_objects.jsonl' 2024-03-09T18:47:45,263 adding 'ochat/evaluation/eval_data/fs_cothub/bbh/movie_recommendation.jsonl' 2024-03-09T18:47:45,286 adding 'ochat/evaluation/eval_data/fs_cothub/bbh/multistep_arithmetic_two.jsonl' 2024-03-09T18:47:45,307 adding 'ochat/evaluation/eval_data/fs_cothub/bbh/navigate.jsonl' 2024-03-09T18:47:45,324 adding 'ochat/evaluation/eval_data/fs_cothub/bbh/object_counting.jsonl' 2024-03-09T18:47:45,339 adding 'ochat/evaluation/eval_data/fs_cothub/bbh/penguins_in_a_table.jsonl' 2024-03-09T18:47:45,365 adding 'ochat/evaluation/eval_data/fs_cothub/bbh/reasoning_about_colored_objects.jsonl' 2024-03-09T18:47:45,398 adding 'ochat/evaluation/eval_data/fs_cothub/bbh/ruin_names.jsonl' 2024-03-09T18:47:45,462 adding 'ochat/evaluation/eval_data/fs_cothub/bbh/salient_translation_error_detection.jsonl' 2024-03-09T18:47:45,494 adding 'ochat/evaluation/eval_data/fs_cothub/bbh/snarks.jsonl' 2024-03-09T18:47:45,507 adding 'ochat/evaluation/eval_data/fs_cothub/bbh/sports_understanding.jsonl' 2024-03-09T18:47:45,543 adding 'ochat/evaluation/eval_data/fs_cothub/bbh/temporal_sequences.jsonl' 2024-03-09T18:47:45,580 adding 'ochat/evaluation/eval_data/fs_cothub/bbh/tracking_shuffled_objects_five_objects.jsonl' 2024-03-09T18:47:45,619 adding 'ochat/evaluation/eval_data/fs_cothub/bbh/tracking_shuffled_objects_seven_objects.jsonl' 2024-03-09T18:47:45,650 adding 'ochat/evaluation/eval_data/fs_cothub/bbh/tracking_shuffled_objects_three_objects.jsonl' 2024-03-09T18:47:45,680 adding 'ochat/evaluation/eval_data/fs_cothub/bbh/web_of_lies.jsonl' 2024-03-09T18:47:45,707 adding 'ochat/evaluation/eval_data/fs_cothub/bbh/word_sorting.jsonl' 2024-03-09T18:47:46,073 adding 'ochat/evaluation/eval_data/fs_cothub/gsm8k/gsm8k.jsonl' 2024-03-09T18:47:46,158 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/abstract_algebra.jsonl' 2024-03-09T18:47:46,181 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/anatomy.jsonl' 2024-03-09T18:47:46,212 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/astronomy.jsonl' 2024-03-09T18:47:46,234 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/business_ethics.jsonl' 2024-03-09T18:47:46,268 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/clinical_knowledge.jsonl' 2024-03-09T18:47:46,302 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/college_biology.jsonl' 2024-03-09T18:47:46,320 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/college_chemistry.jsonl' 2024-03-09T18:47:46,347 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/college_computer_science.jsonl' 2024-03-09T18:47:46,367 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/college_mathematics.jsonl' 2024-03-09T18:47:46,408 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/college_medicine.jsonl' 2024-03-09T18:47:46,428 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/college_physics.jsonl' 2024-03-09T18:47:46,444 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/computer_security.jsonl' 2024-03-09T18:47:46,470 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/conceptual_physics.jsonl' 2024-03-09T18:47:46,497 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/econometrics.jsonl' 2024-03-09T18:47:46,516 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/electrical_engineering.jsonl' 2024-03-09T18:47:46,561 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/elementary_mathematics.jsonl' 2024-03-09T18:47:46,590 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/formal_logic.jsonl' 2024-03-09T18:47:46,819 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/global_facts.jsonl' 2024-03-09T18:47:46,880 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_biology.jsonl' 2024-03-09T18:47:46,921 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_chemistry.jsonl' 2024-03-09T18:47:46,950 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_computer_science.jsonl' 2024-03-09T18:47:47,073 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_european_history.jsonl' 2024-03-09T18:47:47,113 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_geography.jsonl' 2024-03-09T18:47:47,149 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_government_and_politics.jsonl' 2024-03-09T18:47:47,205 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_macroeconomics.jsonl' 2024-03-09T18:47:47,243 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_mathematics.jsonl' 2024-03-09T18:47:47,282 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_microeconomics.jsonl' 2024-03-09T18:47:47,311 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_physics.jsonl' 2024-03-09T18:47:47,405 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_psychology.jsonl' 2024-03-09T18:47:47,466 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_statistics.jsonl' 2024-03-09T18:47:47,602 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_us_history.jsonl' 2024-03-09T18:47:47,748 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_world_history.jsonl' 2024-03-09T18:47:47,783 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/human_aging.jsonl' 2024-03-09T18:47:47,802 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/human_sexuality.jsonl' 2024-03-09T18:47:47,829 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/international_law.jsonl' 2024-03-09T18:47:47,850 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/jurisprudence.jsonl' 2024-03-09T18:47:47,877 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/logical_fallacies.jsonl' 2024-03-09T18:47:47,900 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/machine_learning.jsonl' 2024-03-09T18:47:47,914 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/management.jsonl' 2024-03-09T18:47:47,949 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/marketing.jsonl' 2024-03-09T18:47:47,967 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/medical_genetics.jsonl' 2024-03-09T18:47:48,046 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/miscellaneous.jsonl' 2024-03-09T18:47:48,116 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/moral_disputes.jsonl' 2024-03-09T18:47:48,235 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/moral_scenarios.jsonl' 2024-03-09T18:47:48,305 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/nutrition.jsonl' 2024-03-09T18:47:48,350 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/philosophy.jsonl' 2024-03-09T18:47:48,404 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/prehistory.jsonl' 2024-03-09T18:47:48,466 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/professional_accounting.jsonl' 2024-03-09T18:47:49,254 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/professional_law.jsonl' 2024-03-09T18:47:49,429 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/professional_medicine.jsonl' 2024-03-09T18:47:49,555 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/professional_psychology.jsonl' 2024-03-09T18:47:49,586 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/public_relations.jsonl' 2024-03-09T18:47:49,681 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/security_studies.jsonl' 2024-03-09T18:47:49,727 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/sociology.jsonl' 2024-03-09T18:47:49,753 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/us_foreign_policy.jsonl' 2024-03-09T18:47:49,775 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/virology.jsonl' 2024-03-09T18:47:49,793 adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/world_religions.jsonl' 2024-03-09T18:47:49,809 adding 'ochat/evaluation/eval_data/zs/agieval/aqua-rat.zero-shot.jsonl' 2024-03-09T18:47:49,912 adding 'ochat/evaluation/eval_data/zs/agieval/logiqa-en.zero-shot.jsonl' 2024-03-09T18:47:49,932 adding 'ochat/evaluation/eval_data/zs/agieval/lsat-ar.zero-shot.jsonl' 2024-03-09T18:47:50,043 adding 'ochat/evaluation/eval_data/zs/agieval/lsat-lr.zero-shot.jsonl' 2024-03-09T18:47:50,201 adding 'ochat/evaluation/eval_data/zs/agieval/lsat-rc.zero-shot.jsonl' 2024-03-09T18:47:50,223 adding 'ochat/evaluation/eval_data/zs/agieval/sat-en-without-passage.zero-shot.jsonl' 2024-03-09T18:47:50,308 adding 'ochat/evaluation/eval_data/zs/agieval/sat-en.zero-shot.jsonl' 2024-03-09T18:47:50,326 adding 'ochat/evaluation/eval_data/zs/agieval/sat-math.zero-shot.jsonl' 2024-03-09T18:47:50,330 adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/boolean_expressions.jsonl' 2024-03-09T18:47:50,355 adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/causal_judgment.jsonl' 2024-03-09T18:47:50,365 adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/date_understanding.jsonl' 2024-03-09T18:47:50,372 adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/disambiguation_qa.jsonl' 2024-03-09T18:47:50,384 adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/formal_fallacies_syllogisms_negation.jsonl' 2024-03-09T18:47:50,392 adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/geometric_shapes.jsonl' 2024-03-09T18:47:50,397 adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/hyperbaton.jsonl' 2024-03-09T18:47:50,407 adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/logical_deduction_five_objects.jsonl' 2024-03-09T18:47:50,421 adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/logical_deduction_seven_objects.jsonl' 2024-03-09T18:47:50,429 adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/logical_deduction_three_objects.jsonl' 2024-03-09T18:47:50,438 adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/movie_recommendation.jsonl' 2024-03-09T18:47:50,443 adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/navigate.jsonl' 2024-03-09T18:47:50,448 adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/penguins_in_a_table.jsonl' 2024-03-09T18:47:50,456 adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/reasoning_about_colored_objects.jsonl' 2024-03-09T18:47:50,463 adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/ruin_names.jsonl' 2024-03-09T18:47:50,482 adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/salient_translation_error_detection.jsonl' 2024-03-09T18:47:50,490 adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/snarks.jsonl' 2024-03-09T18:47:50,495 adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/sports_understanding.jsonl' 2024-03-09T18:47:50,506 adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/temporal_sequences.jsonl' 2024-03-09T18:47:50,519 adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/tracking_shuffled_objects_five_objects.jsonl' 2024-03-09T18:47:50,537 adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/tracking_shuffled_objects_seven_objects.jsonl' 2024-03-09T18:47:50,547 adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/tracking_shuffled_objects_three_objects.jsonl' 2024-03-09T18:47:50,553 adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/web_of_lies.jsonl' 2024-03-09T18:47:51,211 adding 'ochat/evaluation/eval_data/zs/math/MATH.jsonl' 2024-03-09T18:47:51,286 adding 'ochat/evaluation/eval_data/zs/truthfulqa_orca/truthfulqa_mc.jsonl' 2024-03-09T18:47:51,289 adding 'ochat/evaluation/grading/math_grader.py' 2024-03-09T18:47:51,291 adding 'ochat/evaluation/grading/math_normalize.py' 2024-03-09T18:47:51,293 adding 'ochat/experimental/generate_dataset_old.py' 2024-03-09T18:47:51,303 adding 'ochat/experimental/sharegpt.ipynb' 2024-03-09T18:47:51,305 adding 'ochat/experimental/test_multipack_dataloader.ipynb' 2024-03-09T18:47:51,307 adding 'ochat/experimental/text_length.ipynb' 2024-03-09T18:47:51,309 adding 'ochat/experimental/train_alpaca.py' 2024-03-09T18:47:51,311 adding 'ochat/experimental/verify_dataset.ipynb' 2024-03-09T18:47:51,314 adding 'ochat/experimental/verify_dataset_orca.ipynb' 2024-03-09T18:47:51,315 adding 'ochat/models/__init__.py' 2024-03-09T18:47:51,317 adding 'ochat/models/unpadded_gemma.py' 2024-03-09T18:47:51,320 adding 'ochat/models/unpadded_llama.py' 2024-03-09T18:47:51,322 adding 'ochat/models/unpadded_mistral.py' 2024-03-09T18:47:51,324 adding 'ochat/scripts/hf_add_tokens.py' 2024-03-09T18:47:51,325 adding 'ochat/scripts/modify_eos_embedding.py' 2024-03-09T18:47:51,327 adding 'ochat/serving/async_tokenizer.py' 2024-03-09T18:47:51,328 adding 'ochat/serving/openai_api_protocol.py' 2024-03-09T18:47:51,330 adding 'ochat/serving/openai_api_server.py' 2024-03-09T18:47:51,333 adding 'ochat/tests/test_model_config.py' 2024-03-09T18:47:51,335 adding 'ochat/training_deepspeed/deepspeed_config.json' 2024-03-09T18:47:51,336 adding 'ochat/training_deepspeed/multipack_sampler.py' 2024-03-09T18:47:51,338 adding 'ochat/training_deepspeed/openchat_dataset.py' 2024-03-09T18:47:51,340 adding 'ochat/training_deepspeed/train.py' 2024-03-09T18:47:51,343 adding 'ochat-3.5.2.dist-info/LICENSE' 2024-03-09T18:47:51,347 adding 'ochat-3.5.2.dist-info/METADATA' 2024-03-09T18:47:51,348 adding 'ochat-3.5.2.dist-info/WHEEL' 2024-03-09T18:47:51,349 adding 'ochat-3.5.2.dist-info/top_level.txt' 2024-03-09T18:47:51,352 adding 'ochat-3.5.2.dist-info/RECORD' 2024-03-09T18:47:51,580 removing build/bdist.linux-armv7l/wheel 2024-03-09T18:47:51,814 Building wheel for ochat (pyproject.toml): finished with status 'done' 2024-03-09T18:47:51,995 Created wheel for ochat: filename=ochat-3.5.2-py3-none-any.whl size=7131985 sha256=8590406928c9d0a36ef4f83fa8fc0d16af3a117803b1bd5ea851ff797fb4db87 2024-03-09T18:47:51,997 Stored in directory: /tmp/pip-ephem-wheel-cache-cuhvqbh8/wheels/49/f0/ba/e6b25018d0aec13521453b8ed90442ea489fa85ed3e509eb30 2024-03-09T18:47:52,027 Successfully built ochat 2024-03-09T18:47:52,471 Removed build tracker: '/tmp/pip-build-tracker-j50l8eut'