Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

我想跑panglao_10000的数据集,但是有报错。 #52

Open
justSOZ opened this issue Apr 17, 2024 · 1 comment
Open

我想跑panglao_10000的数据集,但是有报错。 #52

justSOZ opened this issue Apr 17, 2024 · 1 comment

Comments

@justSOZ
Copy link

justSOZ commented Apr 17, 2024

(torch) server@lthpc-desktop:~/zjc_test_anytime-can-be-deleted $ python -m torch.distributed.run finetune.py
/home/server/anaconda3/envs/torch/lib/python3.8/site-packages/anndata/_core/anndata.py:1838: UserWarning: Observation names are not unique. To make them unique, call .obs_names_make_unique.
utils.warn_names_duplicates("obs")
Traceback (most recent call last):
File "/home/server/anaconda3/envs/torch/lib/python3.8/site-packages/pandas/core/indexes/base.py", line 3653, in get_loc
return self._engine.get_loc(casted_key)
File "pandas/_libs/index.pyx", line 147, in pandas._libs.index.IndexEngine.get_loc
File "pandas/_libs/index.pyx", line 176, in pandas._libs.index.IndexEngine.get_loc
File "pandas/_libs/hashtable_class_helper.pxi", line 7080, in pandas._libs.hashtable.PyObjectHashTable.get_item
File "pandas/_libs/hashtable_class_helper.pxi", line 7088, in pandas._libs.hashtable.PyObjectHashTable.get_item
KeyError: 'celltype'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "finetune.py", line 131, in
label_dict, label = np.unique(np.array(data.obs['celltype']), return_inverse=True) # Convert strings categorical to integrate categorical, and label_dict[label] can be restored
File "/home/server/anaconda3/envs/torch/lib/python3.8/site-packages/pandas/core/frame.py", line 3761, in getitem
indexer = self.columns.get_loc(key)
File "/home/server/anaconda3/envs/torch/lib/python3.8/site-packages/pandas/core/indexes/base.py", line 3655, in get_loc
raise KeyError(key) from err
KeyError: 'celltype'
[2024-04-17 16:58:34,877] torch.distributed.elastic.multiprocessing.api: [ERROR] failed (exitcode: 1) local_rank: 0 (pid: 1109423) of binary: /home/server/anaconda3/envs/torch/bin/python
Traceback (most recent call last):
File "/home/server/anaconda3/envs/torch/lib/python3.8/runpy.py", line 192, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/home/server/anaconda3/envs/torch/lib/python3.8/runpy.py", line 85, in _run_code
exec(code, run_globals)
File "/home/server/.local/lib/python3.8/site-packages/torch/distributed/run.py", line 810, in
main()
File "/home/server/.local/lib/python3.8/site-packages/torch/distributed/elastic/multiprocessing/errors/init.py", line 346, in wrapper
return f(*args, **kwargs)
File "/home/server/.local/lib/python3.8/site-packages/torch/distributed/run.py", line 806, in main
run(args)
File "/home/server/.local/lib/python3.8/site-packages/torch/distributed/run.py", line 797, in run
elastic_launch(
File "/home/server/.local/lib/python3.8/site-packages/torch/distributed/launcher/api.py", line 134, in call
return launch_agent(self._config, self._entrypoint, list(args))
File "/home/server/.local/lib/python3.8/site-packages/torch/distributed/launcher/api.py", line 264, in launch_agent
raise ChildFailedError(
torch.distributed.elastic.multiprocessing.errors.ChildFailedError:

finetune.py FAILED

Failures:
<NO_OTHER_FAILURES>

Root Cause (first observed failure):
[0]:
time : 2024-04-17_16:58:34
host : lthpc-desktop
rank : 0 (local_rank: 0)
exitcode : 1 (pid: 1109423)
error_file: <N/A>
traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html

这是报错主题,然后,我正在看看是不是数据本身就有问题??一个是有标签的数据,还是一个是没有标签的数据

@wangnuo-log
Copy link

你这个看起来像是合并在一起的数据没有celltype的这个列啊,所以没有办法进行微调的操作

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants