2023-12-14T06:13:34,676 Created temporary directory: /tmp/pip-build-tracker-en7dv02t
2023-12-14T06:13:34,678 Initialized build tracking at /tmp/pip-build-tracker-en7dv02t
2023-12-14T06:13:34,678 Created build tracker: /tmp/pip-build-tracker-en7dv02t
2023-12-14T06:13:34,679 Entered build tracker: /tmp/pip-build-tracker-en7dv02t
2023-12-14T06:13:34,680 Created temporary directory: /tmp/pip-wheel-48v78fes
2023-12-14T06:13:34,683 Created temporary directory: /tmp/pip-ephem-wheel-cache-5mjha8jb
2023-12-14T06:13:34,705 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2023-12-14T06:13:34,709 2 location(s) to search for versions of ochat:
2023-12-14T06:13:34,709 * https://pypi.org/simple/ochat/
2023-12-14T06:13:34,709 * https://www.piwheels.org/simple/ochat/
2023-12-14T06:13:34,709 Fetching project page and analyzing links: https://pypi.org/simple/ochat/
2023-12-14T06:13:34,710 Getting page https://pypi.org/simple/ochat/
2023-12-14T06:13:34,712 Found index url https://pypi.org/simple/
2023-12-14T06:13:34,928 Fetched page https://pypi.org/simple/ochat/ as application/vnd.pypi.simple.v1+json
2023-12-14T06:13:34,932   Skipping link: No binaries permitted for ochat: https://files.pythonhosted.org/packages/fe/b4/808ac7c8de6ce5f4bb096d0665754d353c268d50e8d1fc60c333fa9a3fa2/ochat-3.1.0-py3-none-any.whl (from https://pypi.org/simple/ochat/) (requires-python:>=3.8)
2023-12-14T06:13:34,933   Found link https://files.pythonhosted.org/packages/c3/ff/7af1c9ee4ff64a55a6484f7bda69978c1f918e70eaa7a7bc0806b3c4fe78/ochat-3.1.0.tar.gz (from https://pypi.org/simple/ochat/) (requires-python:>=3.8), version: 3.1.0
2023-12-14T06:13:34,933   Skipping link: No binaries permitted for ochat: https://files.pythonhosted.org/packages/3e/01/089be44ecc8cc20388c8f4238c7c13e8822d43affe6bda4c6c28998a9c32/ochat-3.1.1-py3-none-any.whl (from https://pypi.org/simple/ochat/) (requires-python:>=3.8)
2023-12-14T06:13:34,934   Found link https://files.pythonhosted.org/packages/72/f1/d9ef664c670b6333933632acbb1eb165a7e970be9572bb6cb740c333cd4a/ochat-3.1.1.tar.gz (from https://pypi.org/simple/ochat/) (requires-python:>=3.8), version: 3.1.1
2023-12-14T06:13:34,935   Skipping link: No binaries permitted for ochat: https://files.pythonhosted.org/packages/65/df/0469097fbeac5ea7a8e57ab5feb561d91cde90f4b85ca66806cfb06caa35/ochat-3.1.2-py3-none-any.whl (from https://pypi.org/simple/ochat/) (requires-python:>=3.8)
2023-12-14T06:13:34,936   Found link https://files.pythonhosted.org/packages/5c/5b/c53e8712f6f3d620b2eff09c9ccc3965a2fbed11d68d9eafdf3f6e0d99f6/ochat-3.1.2.tar.gz (from https://pypi.org/simple/ochat/) (requires-python:>=3.8), version: 3.1.2
2023-12-14T06:13:34,937   Skipping link: No binaries permitted for ochat: https://files.pythonhosted.org/packages/6d/e6/81b4661a87268167347793a90c4f18696dab713d5ac70f13e622eb02e349/ochat-3.2.0-py3-none-any.whl (from https://pypi.org/simple/ochat/) (requires-python:>=3.8)
2023-12-14T06:13:34,938   Found link https://files.pythonhosted.org/packages/74/04/0220df0d03f98c86a86c4ac45555df2c0945f3e4c90271d609830fad59db/ochat-3.2.0.tar.gz (from https://pypi.org/simple/ochat/) (requires-python:>=3.8), version: 3.2.0
2023-12-14T06:13:34,939   Skipping link: No binaries permitted for ochat: https://files.pythonhosted.org/packages/32/50/7b206a868c8b770aef44acb5fbc3ab0d3372c5744495ce9f83879ef147cf/ochat-3.2.1-py3-none-any.whl (from https://pypi.org/simple/ochat/) (requires-python:>=3.8)
2023-12-14T06:13:34,940   Found link https://files.pythonhosted.org/packages/8c/3e/deb412871d042a507d6b21468e8d3eebbf4359f51840fab4d52a4157709d/ochat-3.2.1.tar.gz (from https://pypi.org/simple/ochat/) (requires-python:>=3.8), version: 3.2.1
2023-12-14T06:13:34,940   Skipping link: No binaries permitted for ochat: https://files.pythonhosted.org/packages/7b/6d/0839b59c99acb15b831970e4d6413c0431303c05fdad22cda6eec2312b84/ochat-3.2.2-py3-none-any.whl (from https://pypi.org/simple/ochat/) (requires-python:>=3.8)
2023-12-14T06:13:34,941   Found link https://files.pythonhosted.org/packages/d1/9a/857acfffc3a11191bda354cc898c40c73eae6e91f34393386eb2c9463598/ochat-3.2.2.tar.gz (from https://pypi.org/simple/ochat/) (requires-python:>=3.8), version: 3.2.2
2023-12-14T06:13:34,942   Skipping link: No binaries permitted for ochat: https://files.pythonhosted.org/packages/f3/46/048120288fcca3bab0be06c44e510bef1e7cd95e68719345e5c028e7e708/ochat-3.5.0-py3-none-any.whl (from https://pypi.org/simple/ochat/) (requires-python:>=3.8)
2023-12-14T06:13:34,943   Found link https://files.pythonhosted.org/packages/b5/7a/b68d3272ddea758835994813b161fdf5308f7306eb9ed7a72a42d8769be5/ochat-3.5.0.tar.gz (from https://pypi.org/simple/ochat/) (requires-python:>=3.8), version: 3.5.0
2023-12-14T06:13:34,944   Skipping link: No binaries permitted for ochat: https://files.pythonhosted.org/packages/7c/1a/19df2691335098b98194c56816f3d2e28dd670145658f355acce5a426d7c/ochat-3.5.1-py3-none-any.whl (from https://pypi.org/simple/ochat/) (requires-python:>=3.8)
2023-12-14T06:13:34,944   Found link https://files.pythonhosted.org/packages/8f/08/5d39d3b3fb012c2da4029043b4a39a94936c9bf6589e3070c0e124c23b02/ochat-3.5.1.tar.gz (from https://pypi.org/simple/ochat/) (requires-python:>=3.8), version: 3.5.1
2023-12-14T06:13:34,945 Fetching project page and analyzing links: https://www.piwheels.org/simple/ochat/
2023-12-14T06:13:34,946 Getting page https://www.piwheels.org/simple/ochat/
2023-12-14T06:13:34,947 Found index url https://www.piwheels.org/simple/
2023-12-14T06:13:35,109 Fetched page https://www.piwheels.org/simple/ochat/ as text/html
2023-12-14T06:13:35,112   Skipping link: No binaries permitted for ochat: https://www.piwheels.org/simple/ochat/ochat-3.5.0-py3-none-any.whl#sha256=51cb913692c5b18614a975f9f3a13c4ec5170948e9f8a965d096dffb5711b52f (from https://www.piwheels.org/simple/ochat/) (requires-python:>=3.8)
2023-12-14T06:13:35,112   Skipping link: No binaries permitted for ochat: https://www.piwheels.org/simple/ochat/ochat-3.2.2-py3-none-any.whl#sha256=82f9cdb40e4eb6049bed1cd4d956e9d08c6c9e14e59dbc626aa0ffbf3b2d4ab4 (from https://www.piwheels.org/simple/ochat/) (requires-python:>=3.8)
2023-12-14T06:13:35,113   Skipping link: No binaries permitted for ochat: https://www.piwheels.org/simple/ochat/ochat-3.2.1-py3-none-any.whl#sha256=c48f21bb9588ce97ac1bb10674a44591b195f66c78b4df03c9cdd1734d82bf7f (from https://www.piwheels.org/simple/ochat/) (requires-python:>=3.8)
2023-12-14T06:13:35,114   Skipping link: No binaries permitted for ochat: https://www.piwheels.org/simple/ochat/ochat-3.2.0-py3-none-any.whl#sha256=c6bef90573e69ac2e3a05617e2e797c6995eb50ab66a10ab776bb4ef1735f0c3 (from https://www.piwheels.org/simple/ochat/) (requires-python:>=3.8)
2023-12-14T06:13:35,114   Skipping link: No binaries permitted for ochat: https://www.piwheels.org/simple/ochat/ochat-3.1.2-py3-none-any.whl#sha256=c699b340bcb856dd84c9b7825e26e7c3f1369021aed89ff7a92f5c2e983128c2 (from https://www.piwheels.org/simple/ochat/) (requires-python:>=3.8)
2023-12-14T06:13:35,115   Skipping link: No binaries permitted for ochat: https://www.piwheels.org/simple/ochat/ochat-3.1.1-py3-none-any.whl#sha256=4a43888d33ed6df656ed57e25d82f4769173a3bbd1603437e18d5d0e89296224 (from https://www.piwheels.org/simple/ochat/) (requires-python:>=3.8)
2023-12-14T06:13:35,116   Skipping link: No binaries permitted for ochat: https://www.piwheels.org/simple/ochat/ochat-3.1.0-py3-none-any.whl#sha256=bb03bf5cf02d51e5590efb243ad814ab65184e83c240bb44237cfeff74a0bdeb (from https://www.piwheels.org/simple/ochat/) (requires-python:>=3.8)
2023-12-14T06:13:35,116 Skipping link: not a file: https://www.piwheels.org/simple/ochat/
2023-12-14T06:13:35,117 Skipping link: not a file: https://pypi.org/simple/ochat/
2023-12-14T06:13:35,137 Given no hashes to check 1 links for project 'ochat': discarding no candidates
2023-12-14T06:13:35,157 Collecting ochat==3.5.1
2023-12-14T06:13:35,159   Created temporary directory: /tmp/pip-unpack-tdku6xro
2023-12-14T06:13:35,412   Downloading ochat-3.5.1.tar.gz (7.9 MB)
2023-12-14T06:13:40,500   Added ochat==3.5.1 from https://files.pythonhosted.org/packages/8f/08/5d39d3b3fb012c2da4029043b4a39a94936c9bf6589e3070c0e124c23b02/ochat-3.5.1.tar.gz to build tracker '/tmp/pip-build-tracker-en7dv02t'
2023-12-14T06:13:40,506   Created temporary directory: /tmp/pip-build-env-55ymulqa
2023-12-14T06:13:40,511   Installing build dependencies: started
2023-12-14T06:13:40,512   Running command pip subprocess to install build dependencies
2023-12-14T06:13:41,794   Using pip 23.3.1 from /home/piwheels/.local/lib/python3.11/site-packages/pip (python 3.11)
2023-12-14T06:13:42,368   Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2023-12-14T06:13:43,804   Collecting setuptools>=45
2023-12-14T06:13:43,822     Using cached https://www.piwheels.org/simple/setuptools/setuptools-69.0.2-py3-none-any.whl (819 kB)
2023-12-14T06:13:44,133   Collecting setuptools_scm>=6.2 (from setuptools_scm[toml]>=6.2)
2023-12-14T06:13:44,148     Using cached https://www.piwheels.org/simple/setuptools-scm/setuptools_scm-8.0.4-py3-none-any.whl (42 kB)
2023-12-14T06:13:44,482   Collecting packaging>=20 (from setuptools_scm>=6.2->setuptools_scm[toml]>=6.2)
2023-12-14T06:13:44,495     Using cached https://www.piwheels.org/simple/packaging/packaging-23.2-py3-none-any.whl (53 kB)
2023-12-14T06:13:44,607   Collecting typing-extensions (from setuptools_scm>=6.2->setuptools_scm[toml]>=6.2)
2023-12-14T06:13:44,622     Using cached https://www.piwheels.org/simple/typing-extensions/typing_extensions-4.9.0-py3-none-any.whl (32 kB)
2023-12-14T06:13:47,267   Installing collected packages: typing-extensions, setuptools, packaging, setuptools_scm
2023-12-14T06:13:49,940   Successfully installed packaging-23.2 setuptools-69.0.2 setuptools_scm-8.0.4 typing-extensions-4.9.0
2023-12-14T06:13:50,474   Installing build dependencies: finished with status 'done'
2023-12-14T06:13:50,477   Getting requirements to build wheel: started
2023-12-14T06:13:50,479   Running command Getting requirements to build wheel
2023-12-14T06:13:51,332   running egg_info
2023-12-14T06:13:51,337   writing ochat.egg-info/PKG-INFO
2023-12-14T06:13:51,341   writing dependency_links to ochat.egg-info/dependency_links.txt
2023-12-14T06:13:51,344   writing requirements to ochat.egg-info/requires.txt
2023-12-14T06:13:51,345   writing top-level names to ochat.egg-info/top_level.txt
2023-12-14T06:13:51,403   ERROR setuptools_scm._file_finders.git listing git files failed - pretending there aren't any
2023-12-14T06:13:51,407   reading manifest file 'ochat.egg-info/SOURCES.txt'
2023-12-14T06:13:51,413   adding license file 'LICENSE'
2023-12-14T06:13:51,420   writing manifest file 'ochat.egg-info/SOURCES.txt'
2023-12-14T06:13:51,537   Getting requirements to build wheel: finished with status 'done'
2023-12-14T06:13:51,548   Installing backend dependencies: started
2023-12-14T06:13:51,549   Running command pip subprocess to install backend dependencies
2023-12-14T06:13:52,714   Using pip 23.3.1 from /home/piwheels/.local/lib/python3.11/site-packages/pip (python 3.11)
2023-12-14T06:13:53,254   Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2023-12-14T06:13:53,737   Collecting wheel
2023-12-14T06:13:53,751     Using cached https://www.piwheels.org/simple/wheel/wheel-0.42.0-py3-none-any.whl (65 kB)
2023-12-14T06:13:56,113   Installing collected packages: wheel
2023-12-14T06:13:56,334     Creating /tmp/pip-build-env-55ymulqa/normal/local/bin
2023-12-14T06:13:56,336     changing mode of /tmp/pip-build-env-55ymulqa/normal/local/bin/wheel to 755
2023-12-14T06:13:56,348   Successfully installed wheel-0.42.0
2023-12-14T06:13:56,828   Installing backend dependencies: finished with status 'done'
2023-12-14T06:13:56,830   Created temporary directory: /tmp/pip-modern-metadata-3t45t876
2023-12-14T06:13:56,832   Preparing metadata (pyproject.toml): started
2023-12-14T06:13:56,833   Running command Preparing metadata (pyproject.toml)
2023-12-14T06:13:57,708   running dist_info
2023-12-14T06:13:57,714   creating /tmp/pip-modern-metadata-3t45t876/ochat.egg-info
2023-12-14T06:13:57,719   writing /tmp/pip-modern-metadata-3t45t876/ochat.egg-info/PKG-INFO
2023-12-14T06:13:57,724   writing dependency_links to /tmp/pip-modern-metadata-3t45t876/ochat.egg-info/dependency_links.txt
2023-12-14T06:13:57,726   writing requirements to /tmp/pip-modern-metadata-3t45t876/ochat.egg-info/requires.txt
2023-12-14T06:13:57,727   writing top-level names to /tmp/pip-modern-metadata-3t45t876/ochat.egg-info/top_level.txt
2023-12-14T06:13:57,728   writing manifest file '/tmp/pip-modern-metadata-3t45t876/ochat.egg-info/SOURCES.txt'
2023-12-14T06:13:57,782   ERROR setuptools_scm._file_finders.git listing git files failed - pretending there aren't any
2023-12-14T06:13:57,786   reading manifest file '/tmp/pip-modern-metadata-3t45t876/ochat.egg-info/SOURCES.txt'
2023-12-14T06:13:57,788   adding license file 'LICENSE'
2023-12-14T06:13:57,790   writing manifest file '/tmp/pip-modern-metadata-3t45t876/ochat.egg-info/SOURCES.txt'
2023-12-14T06:13:57,791   creating '/tmp/pip-modern-metadata-3t45t876/ochat-3.5.1.dist-info'
2023-12-14T06:13:57,953   Preparing metadata (pyproject.toml): finished with status 'done'
2023-12-14T06:13:57,960   Source in /tmp/pip-wheel-48v78fes/ochat_a94c6faf369e40f98f4e3344d04083a6 has version 3.5.1, which satisfies requirement ochat==3.5.1 from https://files.pythonhosted.org/packages/8f/08/5d39d3b3fb012c2da4029043b4a39a94936c9bf6589e3070c0e124c23b02/ochat-3.5.1.tar.gz
2023-12-14T06:13:57,961   Removed ochat==3.5.1 from https://files.pythonhosted.org/packages/8f/08/5d39d3b3fb012c2da4029043b4a39a94936c9bf6589e3070c0e124c23b02/ochat-3.5.1.tar.gz from build tracker '/tmp/pip-build-tracker-en7dv02t'
2023-12-14T06:13:57,969 Created temporary directory: /tmp/pip-unpack-cc7e_mmi
2023-12-14T06:13:57,970 Created temporary directory: /tmp/pip-unpack-ybadqsrp
2023-12-14T06:13:57,995 Building wheels for collected packages: ochat
2023-12-14T06:13:58,000   Created temporary directory: /tmp/pip-wheel-sb1h_hjn
2023-12-14T06:13:58,001   Destination directory: /tmp/pip-wheel-sb1h_hjn
2023-12-14T06:13:58,003   Building wheel for ochat (pyproject.toml): started
2023-12-14T06:13:58,004   Running command Building wheel for ochat (pyproject.toml)
2023-12-14T06:13:58,825   running bdist_wheel
2023-12-14T06:13:58,848   running build
2023-12-14T06:13:58,848   running build_py
2023-12-14T06:13:58,853   creating build
2023-12-14T06:13:58,854   creating build/lib
2023-12-14T06:13:58,855   creating build/lib/ochat
2023-12-14T06:13:58,856   copying ochat/__init__.py -> build/lib/ochat
2023-12-14T06:13:58,858   creating build/lib/ochat/data
2023-12-14T06:13:58,859   copying ochat/data/generate_dataset.py -> build/lib/ochat/data
2023-12-14T06:13:58,861   creating build/lib/ochat/serving
2023-12-14T06:13:58,862   copying ochat/serving/openai_api_server.py -> build/lib/ochat/serving
2023-12-14T06:13:58,865   copying ochat/serving/async_tokenizer.py -> build/lib/ochat/serving
2023-12-14T06:13:58,866   copying ochat/serving/openai_api_protocol.py -> build/lib/ochat/serving
2023-12-14T06:13:58,868   creating build/lib/ochat/experimental
2023-12-14T06:13:58,869   copying ochat/experimental/train_alpaca.py -> build/lib/ochat/experimental
2023-12-14T06:13:58,872   copying ochat/experimental/generate_dataset_old.py -> build/lib/ochat/experimental
2023-12-14T06:13:58,874   creating build/lib/ochat/tests
2023-12-14T06:13:58,875   copying ochat/tests/test_model_config.py -> build/lib/ochat/tests
2023-12-14T06:13:58,878   creating build/lib/ochat/scripts
2023-12-14T06:13:58,879   copying ochat/scripts/convert_llama_weights_to_hf_add_tokens.py -> build/lib/ochat/scripts
2023-12-14T06:13:58,881   copying ochat/scripts/mistral_add_tokens.py -> build/lib/ochat/scripts
2023-12-14T06:13:58,883   creating build/lib/ochat/training_deepspeed
2023-12-14T06:13:58,884   copying ochat/training_deepspeed/train.py -> build/lib/ochat/training_deepspeed
2023-12-14T06:13:58,887   copying ochat/training_deepspeed/multipack_sampler.py -> build/lib/ochat/training_deepspeed
2023-12-14T06:13:58,889   copying ochat/training_deepspeed/openchat_dataset.py -> build/lib/ochat/training_deepspeed
2023-12-14T06:13:58,891   creating build/lib/ochat/evaluation
2023-12-14T06:13:58,892   copying ochat/evaluation/run_eval.py -> build/lib/ochat/evaluation
2023-12-14T06:13:58,894   copying ochat/evaluation/convert_to_evalplus.py -> build/lib/ochat/evaluation
2023-12-14T06:13:58,896   copying ochat/evaluation/match_answer.py -> build/lib/ochat/evaluation
2023-12-14T06:13:58,898   copying ochat/evaluation/view_results.py -> build/lib/ochat/evaluation
2023-12-14T06:13:58,900   copying ochat/evaluation/conv_eval.py -> build/lib/ochat/evaluation
2023-12-14T06:13:58,902   creating build/lib/ochat/models
2023-12-14T06:13:58,903   copying ochat/models/unpadded_mistral.py -> build/lib/ochat/models
2023-12-14T06:13:58,905   copying ochat/models/__init__.py -> build/lib/ochat/models
2023-12-14T06:13:58,907   copying ochat/models/unpadded_llama.py -> build/lib/ochat/models
2023-12-14T06:13:58,910   creating build/lib/ochat/config
2023-12-14T06:13:58,910   copying ochat/config/__init__.py -> build/lib/ochat/config
2023-12-14T06:13:58,912   copying ochat/config/conversation_template.py -> build/lib/ochat/config
2023-12-14T06:13:58,914   copying ochat/config/model_config.py -> build/lib/ochat/config
2023-12-14T06:13:58,916   creating build/lib/ochat/evaluation/grading
2023-12-14T06:13:58,917   copying ochat/evaluation/grading/math_grader.py -> build/lib/ochat/evaluation/grading
2023-12-14T06:13:58,919   copying ochat/evaluation/grading/math_normalize.py -> build/lib/ochat/evaluation/grading
2023-12-14T06:13:58,925   running egg_info
2023-12-14T06:13:58,930   writing ochat.egg-info/PKG-INFO
2023-12-14T06:13:58,934   writing dependency_links to ochat.egg-info/dependency_links.txt
2023-12-14T06:13:58,935   writing requirements to ochat.egg-info/requires.txt
2023-12-14T06:13:58,937   writing top-level names to ochat.egg-info/top_level.txt
2023-12-14T06:13:58,976   ERROR setuptools_scm._file_finders.git listing git files failed - pretending there aren't any
2023-12-14T06:13:58,979   reading manifest file 'ochat.egg-info/SOURCES.txt'
2023-12-14T06:13:59,000   adding license file 'LICENSE'
2023-12-14T06:13:59,007   writing manifest file 'ochat.egg-info/SOURCES.txt'
2023-12-14T06:13:59,024   copying ochat/experimental/sharegpt.ipynb -> build/lib/ochat/experimental
2023-12-14T06:13:59,027   copying ochat/experimental/test_multipack_dataloader.ipynb -> build/lib/ochat/experimental
2023-12-14T06:13:59,030   copying ochat/experimental/text_length.ipynb -> build/lib/ochat/experimental
2023-12-14T06:13:59,033   copying ochat/experimental/verify_dataset.ipynb -> build/lib/ochat/experimental
2023-12-14T06:13:59,035   copying ochat/experimental/verify_dataset_orca.ipynb -> build/lib/ochat/experimental
2023-12-14T06:13:59,038   copying ochat/training_deepspeed/deepspeed_config.json -> build/lib/ochat/training_deepspeed
2023-12-14T06:13:59,040   copying ochat/evaluation/README.md -> build/lib/ochat/evaluation
2023-12-14T06:13:59,042   creating build/lib/ochat/evaluation/eval_data
2023-12-14T06:13:59,042   creating build/lib/ochat/evaluation/eval_data/zs
2023-12-14T06:13:59,043   creating build/lib/ochat/evaluation/eval_data/zs/math
2023-12-14T06:13:59,044   copying ochat/evaluation/eval_data/zs/math/MATH.jsonl -> build/lib/ochat/evaluation/eval_data/zs/math
2023-12-14T06:13:59,144   creating build/lib/ochat/evaluation/eval_data/zs/truthfulqa_orca
2023-12-14T06:13:59,145   copying ochat/evaluation/eval_data/zs/truthfulqa_orca/truthfulqa_mc.jsonl -> build/lib/ochat/evaluation/eval_data/zs/truthfulqa_orca
2023-12-14T06:13:59,151   creating build/lib/ochat/evaluation/eval_data/zs/agieval
2023-12-14T06:13:59,152   copying ochat/evaluation/eval_data/zs/agieval/aqua-rat.zero-shot.jsonl -> build/lib/ochat/evaluation/eval_data/zs/agieval
2023-12-14T06:13:59,156   copying ochat/evaluation/eval_data/zs/agieval/logiqa-en.zero-shot.jsonl -> build/lib/ochat/evaluation/eval_data/zs/agieval
2023-12-14T06:13:59,170   copying ochat/evaluation/eval_data/zs/agieval/lsat-ar.zero-shot.jsonl -> build/lib/ochat/evaluation/eval_data/zs/agieval
2023-12-14T06:13:59,176   copying ochat/evaluation/eval_data/zs/agieval/lsat-lr.zero-shot.jsonl -> build/lib/ochat/evaluation/eval_data/zs/agieval
2023-12-14T06:13:59,187   copying ochat/evaluation/eval_data/zs/agieval/lsat-rc.zero-shot.jsonl -> build/lib/ochat/evaluation/eval_data/zs/agieval
2023-12-14T06:13:59,205   copying ochat/evaluation/eval_data/zs/agieval/sat-en-without-passage.zero-shot.jsonl -> build/lib/ochat/evaluation/eval_data/zs/agieval
2023-12-14T06:13:59,210   copying ochat/evaluation/eval_data/zs/agieval/sat-en.zero-shot.jsonl -> build/lib/ochat/evaluation/eval_data/zs/agieval
2023-12-14T06:13:59,233   copying ochat/evaluation/eval_data/zs/agieval/sat-math.zero-shot.jsonl -> build/lib/ochat/evaluation/eval_data/zs/agieval
2023-12-14T06:13:59,237   creating build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:13:59,238   copying ochat/evaluation/eval_data/zs/bbh_mc_orca/boolean_expressions.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:13:59,241   copying ochat/evaluation/eval_data/zs/bbh_mc_orca/causal_judgment.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:13:59,248   copying ochat/evaluation/eval_data/zs/bbh_mc_orca/date_understanding.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:13:59,252   copying ochat/evaluation/eval_data/zs/bbh_mc_orca/disambiguation_qa.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:13:59,257   copying ochat/evaluation/eval_data/zs/bbh_mc_orca/formal_fallacies_syllogisms_negation.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:13:59,262   copying ochat/evaluation/eval_data/zs/bbh_mc_orca/geometric_shapes.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:13:59,266   copying ochat/evaluation/eval_data/zs/bbh_mc_orca/hyperbaton.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:13:59,269   copying ochat/evaluation/eval_data/zs/bbh_mc_orca/logical_deduction_five_objects.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:13:59,275   copying ochat/evaluation/eval_data/zs/bbh_mc_orca/logical_deduction_seven_objects.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:13:59,281   copying ochat/evaluation/eval_data/zs/bbh_mc_orca/logical_deduction_three_objects.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:13:59,286   copying ochat/evaluation/eval_data/zs/bbh_mc_orca/movie_recommendation.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:13:59,290   copying ochat/evaluation/eval_data/zs/bbh_mc_orca/navigate.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:13:59,294   copying ochat/evaluation/eval_data/zs/bbh_mc_orca/penguins_in_a_table.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:13:59,297   copying ochat/evaluation/eval_data/zs/bbh_mc_orca/reasoning_about_colored_objects.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:13:59,302   copying ochat/evaluation/eval_data/zs/bbh_mc_orca/ruin_names.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:13:59,306   copying ochat/evaluation/eval_data/zs/bbh_mc_orca/salient_translation_error_detection.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:13:59,313   copying ochat/evaluation/eval_data/zs/bbh_mc_orca/snarks.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:13:59,316   copying ochat/evaluation/eval_data/zs/bbh_mc_orca/sports_understanding.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:13:59,321   copying ochat/evaluation/eval_data/zs/bbh_mc_orca/temporal_sequences.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:13:59,326   copying ochat/evaluation/eval_data/zs/bbh_mc_orca/tracking_shuffled_objects_five_objects.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:13:59,332   copying ochat/evaluation/eval_data/zs/bbh_mc_orca/tracking_shuffled_objects_seven_objects.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:13:59,339   copying ochat/evaluation/eval_data/zs/bbh_mc_orca/tracking_shuffled_objects_three_objects.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:13:59,345   copying ochat/evaluation/eval_data/zs/bbh_mc_orca/web_of_lies.jsonl -> build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:13:59,349   creating build/lib/ochat/evaluation/eval_data/fs_cothub
2023-12-14T06:13:59,350   creating build/lib/ochat/evaluation/eval_data/fs_cothub/gsm8k
2023-12-14T06:13:59,350   copying ochat/evaluation/eval_data/fs_cothub/gsm8k/gsm8k.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/gsm8k
2023-12-14T06:13:59,520   creating build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:13:59,521   copying ochat/evaluation/eval_data/fs_cothub/mmlu/abstract_algebra.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:13:59,531   copying ochat/evaluation/eval_data/fs_cothub/mmlu/anatomy.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:13:59,545   copying ochat/evaluation/eval_data/fs_cothub/mmlu/astronomy.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:13:59,559   copying ochat/evaluation/eval_data/fs_cothub/mmlu/business_ethics.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:13:59,571   copying ochat/evaluation/eval_data/fs_cothub/mmlu/clinical_knowledge.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:13:59,590   copying ochat/evaluation/eval_data/fs_cothub/mmlu/college_biology.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:13:59,606   copying ochat/evaluation/eval_data/fs_cothub/mmlu/college_chemistry.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:13:59,616   copying ochat/evaluation/eval_data/fs_cothub/mmlu/college_computer_science.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:13:59,628   copying ochat/evaluation/eval_data/fs_cothub/mmlu/college_mathematics.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:13:59,639   copying ochat/evaluation/eval_data/fs_cothub/mmlu/college_medicine.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:13:59,699   copying ochat/evaluation/eval_data/fs_cothub/mmlu/college_physics.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:13:59,712   copying ochat/evaluation/eval_data/fs_cothub/mmlu/computer_security.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:13:59,722   copying ochat/evaluation/eval_data/fs_cothub/mmlu/conceptual_physics.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:13:59,741   copying ochat/evaluation/eval_data/fs_cothub/mmlu/econometrics.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:13:59,760   copying ochat/evaluation/eval_data/fs_cothub/mmlu/electrical_engineering.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:13:59,851   copying ochat/evaluation/eval_data/fs_cothub/mmlu/elementary_mathematics.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:13:59,870   copying ochat/evaluation/eval_data/fs_cothub/mmlu/formal_logic.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:13:59,882   copying ochat/evaluation/eval_data/fs_cothub/mmlu/global_facts.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:13:59,889   copying ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_biology.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:13:59,916   copying ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_chemistry.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:13:59,932   copying ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_computer_science.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:13:59,947   copying ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_european_history.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:00,004   copying ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_geography.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:00,020   copying ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_government_and_politics.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:00,036   copying ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_macroeconomics.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:00,058   copying ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_mathematics.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:00,072   copying ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_microeconomics.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:00,087   copying ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_physics.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:00,096   copying ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_psychology.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:00,131   copying ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_statistics.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:00,149   copying ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_us_history.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:00,192   copying ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_world_history.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:00,223   copying ochat/evaluation/eval_data/fs_cothub/mmlu/human_aging.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:00,233   copying ochat/evaluation/eval_data/fs_cothub/mmlu/human_sexuality.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:00,240   copying ochat/evaluation/eval_data/fs_cothub/mmlu/international_law.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:00,251   copying ochat/evaluation/eval_data/fs_cothub/mmlu/jurisprudence.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:00,259   copying ochat/evaluation/eval_data/fs_cothub/mmlu/logical_fallacies.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:00,272   copying ochat/evaluation/eval_data/fs_cothub/mmlu/machine_learning.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:00,282   copying ochat/evaluation/eval_data/fs_cothub/mmlu/management.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:00,288   copying ochat/evaluation/eval_data/fs_cothub/mmlu/marketing.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:00,302   copying ochat/evaluation/eval_data/fs_cothub/mmlu/medical_genetics.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:00,308   copying ochat/evaluation/eval_data/fs_cothub/mmlu/miscellaneous.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:00,336   copying ochat/evaluation/eval_data/fs_cothub/mmlu/moral_disputes.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:00,363   copying ochat/evaluation/eval_data/fs_cothub/mmlu/moral_scenarios.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:00,417   copying ochat/evaluation/eval_data/fs_cothub/mmlu/nutrition.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:00,436   copying ochat/evaluation/eval_data/fs_cothub/mmlu/philosophy.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:00,452   copying ochat/evaluation/eval_data/fs_cothub/mmlu/prehistory.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:00,473   copying ochat/evaluation/eval_data/fs_cothub/mmlu/professional_accounting.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:00,491   copying ochat/evaluation/eval_data/fs_cothub/mmlu/professional_law.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:00,707   copying ochat/evaluation/eval_data/fs_cothub/mmlu/professional_medicine.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:00,734   copying ochat/evaluation/eval_data/fs_cothub/mmlu/professional_psychology.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:00,777   copying ochat/evaluation/eval_data/fs_cothub/mmlu/public_relations.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:00,785   copying ochat/evaluation/eval_data/fs_cothub/mmlu/security_studies.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:00,813   copying ochat/evaluation/eval_data/fs_cothub/mmlu/sociology.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:00,825   copying ochat/evaluation/eval_data/fs_cothub/mmlu/us_foreign_policy.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:00,833   copying ochat/evaluation/eval_data/fs_cothub/mmlu/virology.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:00,841   copying ochat/evaluation/eval_data/fs_cothub/mmlu/world_religions.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:00,849   creating build/lib/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:00,850   copying ochat/evaluation/eval_data/fs_cothub/bbh/boolean_expressions.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:00,859   copying ochat/evaluation/eval_data/fs_cothub/bbh/causal_judgement.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:00,876   copying ochat/evaluation/eval_data/fs_cothub/bbh/date_understanding.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:00,884   copying ochat/evaluation/eval_data/fs_cothub/bbh/disambiguation_qa.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:00,902   copying ochat/evaluation/eval_data/fs_cothub/bbh/dyck_languages.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:00,916   copying ochat/evaluation/eval_data/fs_cothub/bbh/formal_fallacies.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:00,938   copying ochat/evaluation/eval_data/fs_cothub/bbh/geometric_shapes.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:00,963   copying ochat/evaluation/eval_data/fs_cothub/bbh/hyperbaton.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:00,985   copying ochat/evaluation/eval_data/fs_cothub/bbh/logical_deduction_five_objects.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:00,999   copying ochat/evaluation/eval_data/fs_cothub/bbh/logical_deduction_seven_objects.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:01,014   copying ochat/evaluation/eval_data/fs_cothub/bbh/logical_deduction_three_objects.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:01,029   copying ochat/evaluation/eval_data/fs_cothub/bbh/movie_recommendation.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:01,041   copying ochat/evaluation/eval_data/fs_cothub/bbh/multistep_arithmetic_two.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:01,055   copying ochat/evaluation/eval_data/fs_cothub/bbh/navigate.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:01,068   copying ochat/evaluation/eval_data/fs_cothub/bbh/object_counting.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:01,078   copying ochat/evaluation/eval_data/fs_cothub/bbh/penguins_in_a_table.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:01,086   copying ochat/evaluation/eval_data/fs_cothub/bbh/reasoning_about_colored_objects.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:01,101   copying ochat/evaluation/eval_data/fs_cothub/bbh/ruin_names.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:01,118   copying ochat/evaluation/eval_data/fs_cothub/bbh/salient_translation_error_detection.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:01,150   copying ochat/evaluation/eval_data/fs_cothub/bbh/snarks.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:01,162   copying ochat/evaluation/eval_data/fs_cothub/bbh/sports_understanding.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:01,168   copying ochat/evaluation/eval_data/fs_cothub/bbh/temporal_sequences.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:01,190   copying ochat/evaluation/eval_data/fs_cothub/bbh/tracking_shuffled_objects_five_objects.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:01,204   copying ochat/evaluation/eval_data/fs_cothub/bbh/tracking_shuffled_objects_seven_objects.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:01,223   copying ochat/evaluation/eval_data/fs_cothub/bbh/tracking_shuffled_objects_three_objects.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:01,238   copying ochat/evaluation/eval_data/fs_cothub/bbh/web_of_lies.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:01,252   copying ochat/evaluation/eval_data/fs_cothub/bbh/word_sorting.jsonl -> build/lib/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:01,266   creating build/lib/ochat/evaluation/eval_data/coding
2023-12-14T06:14:01,266   creating build/lib/ochat/evaluation/eval_data/coding/humaneval
2023-12-14T06:14:01,267   copying ochat/evaluation/eval_data/coding/humaneval/humaneval.jsonl -> build/lib/ochat/evaluation/eval_data/coding/humaneval
2023-12-14T06:14:01,480   installing to build/bdist.linux-armv7l/wheel
2023-12-14T06:14:01,481   running install
2023-12-14T06:14:01,505   running install_lib
2023-12-14T06:14:01,511   creating build/bdist.linux-armv7l
2023-12-14T06:14:01,511   creating build/bdist.linux-armv7l/wheel
2023-12-14T06:14:01,513   creating build/bdist.linux-armv7l/wheel/ochat
2023-12-14T06:14:01,514   creating build/bdist.linux-armv7l/wheel/ochat/data
2023-12-14T06:14:01,515   copying build/lib/ochat/data/generate_dataset.py -> build/bdist.linux-armv7l/wheel/ochat/data
2023-12-14T06:14:01,518   creating build/bdist.linux-armv7l/wheel/ochat/serving
2023-12-14T06:14:01,519   copying build/lib/ochat/serving/openai_api_server.py -> build/bdist.linux-armv7l/wheel/ochat/serving
2023-12-14T06:14:01,521   copying build/lib/ochat/serving/async_tokenizer.py -> build/bdist.linux-armv7l/wheel/ochat/serving
2023-12-14T06:14:01,523   copying build/lib/ochat/serving/openai_api_protocol.py -> build/bdist.linux-armv7l/wheel/ochat/serving
2023-12-14T06:14:01,525   copying build/lib/ochat/__init__.py -> build/bdist.linux-armv7l/wheel/ochat
2023-12-14T06:14:01,527   creating build/bdist.linux-armv7l/wheel/ochat/experimental
2023-12-14T06:14:01,528   copying build/lib/ochat/experimental/text_length.ipynb -> build/bdist.linux-armv7l/wheel/ochat/experimental
2023-12-14T06:14:01,530   copying build/lib/ochat/experimental/sharegpt.ipynb -> build/bdist.linux-armv7l/wheel/ochat/experimental
2023-12-14T06:14:01,534   copying build/lib/ochat/experimental/test_multipack_dataloader.ipynb -> build/bdist.linux-armv7l/wheel/ochat/experimental
2023-12-14T06:14:01,536   copying build/lib/ochat/experimental/verify_dataset.ipynb -> build/bdist.linux-armv7l/wheel/ochat/experimental
2023-12-14T06:14:01,538   copying build/lib/ochat/experimental/verify_dataset_orca.ipynb -> build/bdist.linux-armv7l/wheel/ochat/experimental
2023-12-14T06:14:01,541   copying build/lib/ochat/experimental/train_alpaca.py -> build/bdist.linux-armv7l/wheel/ochat/experimental
2023-12-14T06:14:01,543   copying build/lib/ochat/experimental/generate_dataset_old.py -> build/bdist.linux-armv7l/wheel/ochat/experimental
2023-12-14T06:14:01,546   creating build/bdist.linux-armv7l/wheel/ochat/tests
2023-12-14T06:14:01,547   copying build/lib/ochat/tests/test_model_config.py -> build/bdist.linux-armv7l/wheel/ochat/tests
2023-12-14T06:14:01,550   creating build/bdist.linux-armv7l/wheel/ochat/scripts
2023-12-14T06:14:01,550   copying build/lib/ochat/scripts/convert_llama_weights_to_hf_add_tokens.py -> build/bdist.linux-armv7l/wheel/ochat/scripts
2023-12-14T06:14:01,557   copying build/lib/ochat/scripts/mistral_add_tokens.py -> build/bdist.linux-armv7l/wheel/ochat/scripts
2023-12-14T06:14:01,559   creating build/bdist.linux-armv7l/wheel/ochat/training_deepspeed
2023-12-14T06:14:01,560   copying build/lib/ochat/training_deepspeed/train.py -> build/bdist.linux-armv7l/wheel/ochat/training_deepspeed
2023-12-14T06:14:01,563   copying build/lib/ochat/training_deepspeed/multipack_sampler.py -> build/bdist.linux-armv7l/wheel/ochat/training_deepspeed
2023-12-14T06:14:01,565   copying build/lib/ochat/training_deepspeed/openchat_dataset.py -> build/bdist.linux-armv7l/wheel/ochat/training_deepspeed
2023-12-14T06:14:01,567   copying build/lib/ochat/training_deepspeed/deepspeed_config.json -> build/bdist.linux-armv7l/wheel/ochat/training_deepspeed
2023-12-14T06:14:01,569   creating build/bdist.linux-armv7l/wheel/ochat/evaluation
2023-12-14T06:14:01,570   copying build/lib/ochat/evaluation/run_eval.py -> build/bdist.linux-armv7l/wheel/ochat/evaluation
2023-12-14T06:14:01,572   copying build/lib/ochat/evaluation/convert_to_evalplus.py -> build/bdist.linux-armv7l/wheel/ochat/evaluation
2023-12-14T06:14:01,574   copying build/lib/ochat/evaluation/match_answer.py -> build/bdist.linux-armv7l/wheel/ochat/evaluation
2023-12-14T06:14:01,577   creating build/bdist.linux-armv7l/wheel/ochat/evaluation/grading
2023-12-14T06:14:01,578   copying build/lib/ochat/evaluation/grading/math_grader.py -> build/bdist.linux-armv7l/wheel/ochat/evaluation/grading
2023-12-14T06:14:01,581   copying build/lib/ochat/evaluation/grading/math_normalize.py -> build/bdist.linux-armv7l/wheel/ochat/evaluation/grading
2023-12-14T06:14:01,583   copying build/lib/ochat/evaluation/view_results.py -> build/bdist.linux-armv7l/wheel/ochat/evaluation
2023-12-14T06:14:01,585   copying build/lib/ochat/evaluation/README.md -> build/bdist.linux-armv7l/wheel/ochat/evaluation
2023-12-14T06:14:01,587   copying build/lib/ochat/evaluation/conv_eval.py -> build/bdist.linux-armv7l/wheel/ochat/evaluation
2023-12-14T06:14:01,590   creating build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data
2023-12-14T06:14:01,591   creating build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs
2023-12-14T06:14:01,592   creating build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/math
2023-12-14T06:14:01,593   copying build/lib/ochat/evaluation/eval_data/zs/math/MATH.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/math
2023-12-14T06:14:01,682   creating build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/truthfulqa_orca
2023-12-14T06:14:01,684   copying build/lib/ochat/evaluation/eval_data/zs/truthfulqa_orca/truthfulqa_mc.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/truthfulqa_orca
2023-12-14T06:14:01,691   creating build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/agieval
2023-12-14T06:14:01,692   copying build/lib/ochat/evaluation/eval_data/zs/agieval/logiqa-en.zero-shot.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/agieval
2023-12-14T06:14:01,704   copying build/lib/ochat/evaluation/eval_data/zs/agieval/sat-en-without-passage.zero-shot.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/agieval
2023-12-14T06:14:01,708   copying build/lib/ochat/evaluation/eval_data/zs/agieval/lsat-lr.zero-shot.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/agieval
2023-12-14T06:14:01,721   copying build/lib/ochat/evaluation/eval_data/zs/agieval/lsat-rc.zero-shot.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/agieval
2023-12-14T06:14:01,743   copying build/lib/ochat/evaluation/eval_data/zs/agieval/sat-en.zero-shot.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/agieval
2023-12-14T06:14:01,760   copying build/lib/ochat/evaluation/eval_data/zs/agieval/aqua-rat.zero-shot.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/agieval
2023-12-14T06:14:01,764   copying build/lib/ochat/evaluation/eval_data/zs/agieval/lsat-ar.zero-shot.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/agieval
2023-12-14T06:14:01,770   copying build/lib/ochat/evaluation/eval_data/zs/agieval/sat-math.zero-shot.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/agieval
2023-12-14T06:14:01,775   creating build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:14:01,776   copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/tracking_shuffled_objects_three_objects.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:14:01,782   copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/snarks.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:14:01,785   copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/disambiguation_qa.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:14:01,790   copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/logical_deduction_five_objects.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:14:01,796   copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/causal_judgment.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:14:01,803   copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/tracking_shuffled_objects_seven_objects.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:14:01,810   copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/sports_understanding.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:14:01,814   copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/date_understanding.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:14:01,818   copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/boolean_expressions.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:14:01,821   copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/logical_deduction_seven_objects.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:14:01,828   copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/reasoning_about_colored_objects.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:14:01,833   copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/tracking_shuffled_objects_five_objects.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:14:01,839   copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/temporal_sequences.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:14:01,844   copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/logical_deduction_three_objects.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:14:01,848   copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/web_of_lies.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:14:01,852   copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/penguins_in_a_table.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:14:01,855   copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/navigate.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:14:01,860   copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/hyperbaton.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:14:01,863   copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/formal_fallacies_syllogisms_negation.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:14:01,869   copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/geometric_shapes.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:14:01,873   copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/salient_translation_error_detection.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:14:01,880   copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/ruin_names.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:14:01,884   copying build/lib/ochat/evaluation/eval_data/zs/bbh_mc_orca/movie_recommendation.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/zs/bbh_mc_orca
2023-12-14T06:14:01,889   creating build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub
2023-12-14T06:14:01,890   creating build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/gsm8k
2023-12-14T06:14:01,891   copying build/lib/ochat/evaluation/eval_data/fs_cothub/gsm8k/gsm8k.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/gsm8k
2023-12-14T06:14:02,065   creating build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:02,066   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/us_foreign_policy.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:02,074   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/clinical_knowledge.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:02,087   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/anatomy.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:02,098   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/prehistory.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:02,122   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/college_physics.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:02,130   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_us_history.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:02,169   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/electrical_engineering.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:02,185   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/medical_genetics.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:02,196   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/public_relations.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:02,208   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/management.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:02,220   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/virology.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:02,232   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_physics.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:02,245   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/philosophy.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:02,264   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_chemistry.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:02,279   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_microeconomics.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:02,294   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/human_sexuality.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:02,302   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_computer_science.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:02,312   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/marketing.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:02,326   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/college_chemistry.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:02,333   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/astronomy.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:02,346   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/logical_fallacies.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:02,359   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/abstract_algebra.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:02,367   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/jurisprudence.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:02,375   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_world_history.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:02,405   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/college_medicine.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:02,423   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_biology.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:02,454   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/professional_psychology.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:02,493   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/nutrition.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:02,516   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_mathematics.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:02,530   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/miscellaneous.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:02,556   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_psychology.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:02,590   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/conceptual_physics.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:02,602   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/computer_security.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:02,609   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_european_history.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:02,655   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/human_aging.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:02,665   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/machine_learning.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:02,675   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_geography.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:02,686   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/professional_medicine.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:02,713   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/business_ethics.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:02,724   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/college_mathematics.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:02,734   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/sociology.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:02,749   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/moral_scenarios.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:02,813   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/professional_law.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:03,012   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/college_biology.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:03,024   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/security_studies.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:03,057   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_macroeconomics.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:03,078   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/world_religions.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:03,086   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/college_computer_science.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:03,097   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_government_and_politics.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:03,109   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/professional_accounting.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:03,127   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/international_law.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:03,140   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/formal_logic.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:03,151   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/moral_disputes.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:03,177   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_statistics.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:03,195   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/econometrics.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:03,206   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/elementary_mathematics.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:03,228   copying build/lib/ochat/evaluation/eval_data/fs_cothub/mmlu/global_facts.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/mmlu
2023-12-14T06:14:03,235   creating build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:03,236   copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/tracking_shuffled_objects_three_objects.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:03,254   copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/snarks.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:03,266   copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/disambiguation_qa.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:03,293   copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/logical_deduction_five_objects.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:03,308   copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/tracking_shuffled_objects_seven_objects.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:03,324   copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/sports_understanding.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:03,330   copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/date_understanding.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:03,338   copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/boolean_expressions.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:03,348   copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/logical_deduction_seven_objects.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:03,364   copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/reasoning_about_colored_objects.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:03,378   copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/tracking_shuffled_objects_five_objects.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:03,442   copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/temporal_sequences.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:03,463   copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/logical_deduction_three_objects.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:03,478   copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/web_of_lies.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:03,495   copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/formal_fallacies.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:03,517   copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/penguins_in_a_table.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:03,527   copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/navigate.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:03,543   copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/hyperbaton.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:03,558   copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/dyck_languages.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:03,570   copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/geometric_shapes.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:03,595   copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/word_sorting.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:03,607   copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/salient_translation_error_detection.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:03,636   copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/ruin_names.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:03,652   copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/multistep_arithmetic_two.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:03,664   copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/object_counting.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:03,672   copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/causal_judgement.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:03,687   copying build/lib/ochat/evaluation/eval_data/fs_cothub/bbh/movie_recommendation.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/fs_cothub/bbh
2023-12-14T06:14:03,698   creating build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/coding
2023-12-14T06:14:03,700   creating build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/coding/humaneval
2023-12-14T06:14:03,701   copying build/lib/ochat/evaluation/eval_data/coding/humaneval/humaneval.jsonl -> build/bdist.linux-armv7l/wheel/ochat/evaluation/eval_data/coding/humaneval
2023-12-14T06:14:03,822   creating build/bdist.linux-armv7l/wheel/ochat/models
2023-12-14T06:14:03,823   copying build/lib/ochat/models/unpadded_mistral.py -> build/bdist.linux-armv7l/wheel/ochat/models
2023-12-14T06:14:03,826   copying build/lib/ochat/models/__init__.py -> build/bdist.linux-armv7l/wheel/ochat/models
2023-12-14T06:14:03,828   copying build/lib/ochat/models/unpadded_llama.py -> build/bdist.linux-armv7l/wheel/ochat/models
2023-12-14T06:14:03,831   creating build/bdist.linux-armv7l/wheel/ochat/config
2023-12-14T06:14:03,832   copying build/lib/ochat/config/__init__.py -> build/bdist.linux-armv7l/wheel/ochat/config
2023-12-14T06:14:03,834   copying build/lib/ochat/config/conversation_template.py -> build/bdist.linux-armv7l/wheel/ochat/config
2023-12-14T06:14:03,836   copying build/lib/ochat/config/model_config.py -> build/bdist.linux-armv7l/wheel/ochat/config
2023-12-14T06:14:03,838   running install_egg_info
2023-12-14T06:14:03,844   Copying ochat.egg-info to build/bdist.linux-armv7l/wheel/ochat-3.5.1-py3.11.egg-info
2023-12-14T06:14:03,855   running install_scripts
2023-12-14T06:14:03,875   creating build/bdist.linux-armv7l/wheel/ochat-3.5.1.dist-info/WHEEL
2023-12-14T06:14:03,878   creating '/tmp/pip-wheel-sb1h_hjn/.tmp-7kls7j8k/ochat-3.5.1-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2023-12-14T06:14:03,880   adding 'ochat/__init__.py'
2023-12-14T06:14:03,883   adding 'ochat/config/__init__.py'
2023-12-14T06:14:03,884   adding 'ochat/config/conversation_template.py'
2023-12-14T06:14:03,886   adding 'ochat/config/model_config.py'
2023-12-14T06:14:03,888   adding 'ochat/data/generate_dataset.py'
2023-12-14T06:14:03,890   adding 'ochat/evaluation/README.md'
2023-12-14T06:14:03,892   adding 'ochat/evaluation/conv_eval.py'
2023-12-14T06:14:03,894   adding 'ochat/evaluation/convert_to_evalplus.py'
2023-12-14T06:14:03,896   adding 'ochat/evaluation/match_answer.py'
2023-12-14T06:14:03,898   adding 'ochat/evaluation/run_eval.py'
2023-12-14T06:14:03,900   adding 'ochat/evaluation/view_results.py'
2023-12-14T06:14:04,609   adding 'ochat/evaluation/eval_data/coding/humaneval/humaneval.jsonl'
2023-12-14T06:14:04,673   adding 'ochat/evaluation/eval_data/fs_cothub/bbh/boolean_expressions.jsonl'
2023-12-14T06:14:04,731   adding 'ochat/evaluation/eval_data/fs_cothub/bbh/causal_judgement.jsonl'
2023-12-14T06:14:04,754   adding 'ochat/evaluation/eval_data/fs_cothub/bbh/date_understanding.jsonl'
2023-12-14T06:14:04,788   adding 'ochat/evaluation/eval_data/fs_cothub/bbh/disambiguation_qa.jsonl'
2023-12-14T06:14:04,815   adding 'ochat/evaluation/eval_data/fs_cothub/bbh/dyck_languages.jsonl'
2023-12-14T06:14:04,864   adding 'ochat/evaluation/eval_data/fs_cothub/bbh/formal_fallacies.jsonl'
2023-12-14T06:14:04,908   adding 'ochat/evaluation/eval_data/fs_cothub/bbh/geometric_shapes.jsonl'
2023-12-14T06:14:04,940   adding 'ochat/evaluation/eval_data/fs_cothub/bbh/hyperbaton.jsonl'
2023-12-14T06:14:04,974   adding 'ochat/evaluation/eval_data/fs_cothub/bbh/logical_deduction_five_objects.jsonl'
2023-12-14T06:14:05,011   adding 'ochat/evaluation/eval_data/fs_cothub/bbh/logical_deduction_seven_objects.jsonl'
2023-12-14T06:14:05,041   adding 'ochat/evaluation/eval_data/fs_cothub/bbh/logical_deduction_three_objects.jsonl'
2023-12-14T06:14:05,067   adding 'ochat/evaluation/eval_data/fs_cothub/bbh/movie_recommendation.jsonl'
2023-12-14T06:14:05,091   adding 'ochat/evaluation/eval_data/fs_cothub/bbh/multistep_arithmetic_two.jsonl'
2023-12-14T06:14:05,112   adding 'ochat/evaluation/eval_data/fs_cothub/bbh/navigate.jsonl'
2023-12-14T06:14:05,129   adding 'ochat/evaluation/eval_data/fs_cothub/bbh/object_counting.jsonl'
2023-12-14T06:14:05,144   adding 'ochat/evaluation/eval_data/fs_cothub/bbh/penguins_in_a_table.jsonl'
2023-12-14T06:14:05,170   adding 'ochat/evaluation/eval_data/fs_cothub/bbh/reasoning_about_colored_objects.jsonl'
2023-12-14T06:14:05,203   adding 'ochat/evaluation/eval_data/fs_cothub/bbh/ruin_names.jsonl'
2023-12-14T06:14:05,266   adding 'ochat/evaluation/eval_data/fs_cothub/bbh/salient_translation_error_detection.jsonl'
2023-12-14T06:14:05,298   adding 'ochat/evaluation/eval_data/fs_cothub/bbh/snarks.jsonl'
2023-12-14T06:14:05,311   adding 'ochat/evaluation/eval_data/fs_cothub/bbh/sports_understanding.jsonl'
2023-12-14T06:14:05,347   adding 'ochat/evaluation/eval_data/fs_cothub/bbh/temporal_sequences.jsonl'
2023-12-14T06:14:05,382   adding 'ochat/evaluation/eval_data/fs_cothub/bbh/tracking_shuffled_objects_five_objects.jsonl'
2023-12-14T06:14:05,421   adding 'ochat/evaluation/eval_data/fs_cothub/bbh/tracking_shuffled_objects_seven_objects.jsonl'
2023-12-14T06:14:05,453   adding 'ochat/evaluation/eval_data/fs_cothub/bbh/tracking_shuffled_objects_three_objects.jsonl'
2023-12-14T06:14:05,482   adding 'ochat/evaluation/eval_data/fs_cothub/bbh/web_of_lies.jsonl'
2023-12-14T06:14:05,509   adding 'ochat/evaluation/eval_data/fs_cothub/bbh/word_sorting.jsonl'
2023-12-14T06:14:05,872   adding 'ochat/evaluation/eval_data/fs_cothub/gsm8k/gsm8k.jsonl'
2023-12-14T06:14:05,956   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/abstract_algebra.jsonl'
2023-12-14T06:14:05,979   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/anatomy.jsonl'
2023-12-14T06:14:06,010   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/astronomy.jsonl'
2023-12-14T06:14:06,033   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/business_ethics.jsonl'
2023-12-14T06:14:06,067   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/clinical_knowledge.jsonl'
2023-12-14T06:14:06,100   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/college_biology.jsonl'
2023-12-14T06:14:06,118   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/college_chemistry.jsonl'
2023-12-14T06:14:06,145   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/college_computer_science.jsonl'
2023-12-14T06:14:06,165   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/college_mathematics.jsonl'
2023-12-14T06:14:06,206   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/college_medicine.jsonl'
2023-12-14T06:14:06,226   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/college_physics.jsonl'
2023-12-14T06:14:06,242   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/computer_security.jsonl'
2023-12-14T06:14:06,269   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/conceptual_physics.jsonl'
2023-12-14T06:14:06,295   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/econometrics.jsonl'
2023-12-14T06:14:06,314   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/electrical_engineering.jsonl'
2023-12-14T06:14:06,359   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/elementary_mathematics.jsonl'
2023-12-14T06:14:06,387   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/formal_logic.jsonl'
2023-12-14T06:14:06,402   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/global_facts.jsonl'
2023-12-14T06:14:06,462   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_biology.jsonl'
2023-12-14T06:14:06,502   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_chemistry.jsonl'
2023-12-14T06:14:06,532   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_computer_science.jsonl'
2023-12-14T06:14:06,654   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_european_history.jsonl'
2023-12-14T06:14:06,695   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_geography.jsonl'
2023-12-14T06:14:06,730   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_government_and_politics.jsonl'
2023-12-14T06:14:06,786   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_macroeconomics.jsonl'
2023-12-14T06:14:06,824   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_mathematics.jsonl'
2023-12-14T06:14:06,862   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_microeconomics.jsonl'
2023-12-14T06:14:06,891   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_physics.jsonl'
2023-12-14T06:14:06,985   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_psychology.jsonl'
2023-12-14T06:14:07,045   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_statistics.jsonl'
2023-12-14T06:14:07,180   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_us_history.jsonl'
2023-12-14T06:14:07,326   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/high_school_world_history.jsonl'
2023-12-14T06:14:07,361   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/human_aging.jsonl'
2023-12-14T06:14:07,380   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/human_sexuality.jsonl'
2023-12-14T06:14:07,407   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/international_law.jsonl'
2023-12-14T06:14:07,427   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/jurisprudence.jsonl'
2023-12-14T06:14:07,454   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/logical_fallacies.jsonl'
2023-12-14T06:14:07,477   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/machine_learning.jsonl'
2023-12-14T06:14:07,492   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/management.jsonl'
2023-12-14T06:14:07,526   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/marketing.jsonl'
2023-12-14T06:14:07,544   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/medical_genetics.jsonl'
2023-12-14T06:14:07,622   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/miscellaneous.jsonl'
2023-12-14T06:14:07,692   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/moral_disputes.jsonl'
2023-12-14T06:14:07,810   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/moral_scenarios.jsonl'
2023-12-14T06:14:07,880   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/nutrition.jsonl'
2023-12-14T06:14:07,925   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/philosophy.jsonl'
2023-12-14T06:14:07,979   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/prehistory.jsonl'
2023-12-14T06:14:08,041   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/professional_accounting.jsonl'
2023-12-14T06:14:08,826   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/professional_law.jsonl'
2023-12-14T06:14:09,001   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/professional_medicine.jsonl'
2023-12-14T06:14:09,126   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/professional_psychology.jsonl'
2023-12-14T06:14:09,157   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/public_relations.jsonl'
2023-12-14T06:14:09,253   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/security_studies.jsonl'
2023-12-14T06:14:09,298   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/sociology.jsonl'
2023-12-14T06:14:09,317   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/us_foreign_policy.jsonl'
2023-12-14T06:14:09,339   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/virology.jsonl'
2023-12-14T06:14:09,357   adding 'ochat/evaluation/eval_data/fs_cothub/mmlu/world_religions.jsonl'
2023-12-14T06:14:09,373   adding 'ochat/evaluation/eval_data/zs/agieval/aqua-rat.zero-shot.jsonl'
2023-12-14T06:14:09,474   adding 'ochat/evaluation/eval_data/zs/agieval/logiqa-en.zero-shot.jsonl'
2023-12-14T06:14:09,495   adding 'ochat/evaluation/eval_data/zs/agieval/lsat-ar.zero-shot.jsonl'
2023-12-14T06:14:09,606   adding 'ochat/evaluation/eval_data/zs/agieval/lsat-lr.zero-shot.jsonl'
2023-12-14T06:14:09,693   adding 'ochat/evaluation/eval_data/zs/agieval/lsat-rc.zero-shot.jsonl'
2023-12-14T06:14:09,715   adding 'ochat/evaluation/eval_data/zs/agieval/sat-en-without-passage.zero-shot.jsonl'
2023-12-14T06:14:09,800   adding 'ochat/evaluation/eval_data/zs/agieval/sat-en.zero-shot.jsonl'
2023-12-14T06:14:09,818   adding 'ochat/evaluation/eval_data/zs/agieval/sat-math.zero-shot.jsonl'
2023-12-14T06:14:09,822   adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/boolean_expressions.jsonl'
2023-12-14T06:14:09,848   adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/causal_judgment.jsonl'
2023-12-14T06:14:09,858   adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/date_understanding.jsonl'
2023-12-14T06:14:09,865   adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/disambiguation_qa.jsonl'
2023-12-14T06:14:09,877   adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/formal_fallacies_syllogisms_negation.jsonl'
2023-12-14T06:14:09,885   adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/geometric_shapes.jsonl'
2023-12-14T06:14:09,890   adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/hyperbaton.jsonl'
2023-12-14T06:14:09,900   adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/logical_deduction_five_objects.jsonl'
2023-12-14T06:14:09,914   adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/logical_deduction_seven_objects.jsonl'
2023-12-14T06:14:09,922   adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/logical_deduction_three_objects.jsonl'
2023-12-14T06:14:09,931   adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/movie_recommendation.jsonl'
2023-12-14T06:14:09,936   adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/navigate.jsonl'
2023-12-14T06:14:09,941   adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/penguins_in_a_table.jsonl'
2023-12-14T06:14:09,949   adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/reasoning_about_colored_objects.jsonl'
2023-12-14T06:14:09,957   adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/ruin_names.jsonl'
2023-12-14T06:14:09,976   adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/salient_translation_error_detection.jsonl'
2023-12-14T06:14:09,985   adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/snarks.jsonl'
2023-12-14T06:14:09,990   adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/sports_understanding.jsonl'
2023-12-14T06:14:10,003   adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/temporal_sequences.jsonl'
2023-12-14T06:14:10,016   adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/tracking_shuffled_objects_five_objects.jsonl'
2023-12-14T06:14:10,033   adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/tracking_shuffled_objects_seven_objects.jsonl'
2023-12-14T06:14:10,043   adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/tracking_shuffled_objects_three_objects.jsonl'
2023-12-14T06:14:10,050   adding 'ochat/evaluation/eval_data/zs/bbh_mc_orca/web_of_lies.jsonl'
2023-12-14T06:14:10,706   adding 'ochat/evaluation/eval_data/zs/math/MATH.jsonl'
2023-12-14T06:14:10,779   adding 'ochat/evaluation/eval_data/zs/truthfulqa_orca/truthfulqa_mc.jsonl'
2023-12-14T06:14:10,783   adding 'ochat/evaluation/grading/math_grader.py'
2023-12-14T06:14:10,785   adding 'ochat/evaluation/grading/math_normalize.py'
2023-12-14T06:14:10,787   adding 'ochat/experimental/generate_dataset_old.py'
2023-12-14T06:14:10,796   adding 'ochat/experimental/sharegpt.ipynb'
2023-12-14T06:14:10,799   adding 'ochat/experimental/test_multipack_dataloader.ipynb'
2023-12-14T06:14:10,801   adding 'ochat/experimental/text_length.ipynb'
2023-12-14T06:14:10,803   adding 'ochat/experimental/train_alpaca.py'
2023-12-14T06:14:10,806   adding 'ochat/experimental/verify_dataset.ipynb'
2023-12-14T06:14:10,810   adding 'ochat/experimental/verify_dataset_orca.ipynb'
2023-12-14T06:14:10,812   adding 'ochat/models/__init__.py'
2023-12-14T06:14:10,814   adding 'ochat/models/unpadded_llama.py'
2023-12-14T06:14:10,817   adding 'ochat/models/unpadded_mistral.py'
2023-12-14T06:14:10,820   adding 'ochat/scripts/convert_llama_weights_to_hf_add_tokens.py'
2023-12-14T06:14:10,822   adding 'ochat/scripts/mistral_add_tokens.py'
2023-12-14T06:14:10,824   adding 'ochat/serving/async_tokenizer.py'
2023-12-14T06:14:10,826   adding 'ochat/serving/openai_api_protocol.py'
2023-12-14T06:14:10,828   adding 'ochat/serving/openai_api_server.py'
2023-12-14T06:14:10,831   adding 'ochat/tests/test_model_config.py'
2023-12-14T06:14:10,833   adding 'ochat/training_deepspeed/deepspeed_config.json'
2023-12-14T06:14:10,835   adding 'ochat/training_deepspeed/multipack_sampler.py'
2023-12-14T06:14:10,837   adding 'ochat/training_deepspeed/openchat_dataset.py'
2023-12-14T06:14:10,839   adding 'ochat/training_deepspeed/train.py'
2023-12-14T06:14:10,842   adding 'ochat-3.5.1.dist-info/LICENSE'
2023-12-14T06:14:10,845   adding 'ochat-3.5.1.dist-info/METADATA'
2023-12-14T06:14:10,847   adding 'ochat-3.5.1.dist-info/WHEEL'
2023-12-14T06:14:10,848   adding 'ochat-3.5.1.dist-info/top_level.txt'
2023-12-14T06:14:10,851   adding 'ochat-3.5.1.dist-info/RECORD'
2023-12-14T06:14:10,928   removing build/bdist.linux-armv7l/wheel
2023-12-14T06:14:11,140   Building wheel for ochat (pyproject.toml): finished with status 'done'
2023-12-14T06:14:11,305   Created wheel for ochat: filename=ochat-3.5.1-py3-none-any.whl size=7130565 sha256=62fd299acc0648741d808f4cdcaa7dd2fc2c087881feb3cf9701f3506c8cd2c8
2023-12-14T06:14:11,306   Stored in directory: /tmp/pip-ephem-wheel-cache-5mjha8jb/wheels/46/d1/13/d9465d12fdddc0a722831ffc674b8cf18dd2f8527e7d620f9f
2023-12-14T06:14:11,327 Successfully built ochat
2023-12-14T06:14:11,518 Removed build tracker: '/tmp/pip-build-tracker-en7dv02t'