问题遇到的现象和发生背景
我在使用VITS训练时，torch pad回报了以下错误
AssertionError: 4D tensors expect 4 values for padding
https://github.com/jaywalnut310/vits
我使用的VITS-japanese
(训练部份基本没修改)
torch版本为1.6.0，是从requirements.txt下的
问题相关代码，请勿粘贴截图
执行代码:
test.json是修改了listfile路径的VITS-japanese/config/nan.json
python train.py -c config/test.json -m test
运行结果及报错内容
Process SpawnProcess-1:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/dist-packages/torch/multiprocessing/spawn.py", line 20, in _wrap
fn(i, *args)
File "/content/vits-japanese/train.py", line 117, in run
train_and_evaluate(rank, epoch, hps, [net_g, net_d], [optim_g, optim_d], [scheduler_g, scheduler_d], scaler, [train_loader, eval_loader], logger, [writer, writer_eval])
File "/content/vits-japanese/train.py", line 137, in train_and_evaluate
for batch_idx, (x, x_lengths, spec, spec_lengths, y, y_lengths) in enumerate(train_loader):
File "/usr/local/lib/python3.7/dist-packages/torch/utils/data/dataloader.py", line 363, in __next__
data = self._next_data()
File "/usr/local/lib/python3.7/dist-packages/torch/utils/data/dataloader.py", line 989, in _next_data
return self._process_data(data)
File "/usr/local/lib/python3.7/dist-packages/torch/utils/data/dataloader.py", line 1014, in _process_data
data.reraise()
File "/usr/local/lib/python3.7/dist-packages/torch/_utils.py", line 395, in reraise
raise self.exc_type(msg)
AssertionError: Caught AssertionError in DataLoader worker process 0.
Original Traceback (most recent call last):
File "/usr/local/lib/python3.7/dist-packages/torch/utils/data/_utils/worker.py", line 185, in _worker_loop
data = fetcher.fetch(index)
File "/usr/local/lib/python3.7/dist-packages/torch/utils/data/_utils/fetch.py", line 44, in fetch
data = [self.dataset[idx] for idx in possibly_batched_index]
File "/usr/local/lib/python3.7/dist-packages/torch/utils/data/_utils/fetch.py", line 44, in <listcomp>
data = [self.dataset[idx] for idx in possibly_batched_index]
File "/content/vits-japanese/data_utils.py", line 97, in __getitem__
return self.get_audio_text_pair(self.audiopaths_and_text[index])
File "/content/vits-japanese/data_utils.py", line 62, in get_audio_text_pair
spec, wav = self.get_audio(audiopath)
File "/content/vits-japanese/data_utils.py", line 81, in get_audio
center=False)
File "/content/vits-japanese/mel_processing.py", line 71, in spectrogram_torch
y = torch.nn.functional.pad(y.unsqueeze(1), (int((n_fft-hop_size)/2), int((n_fft-hop_size)/2)), mode='reflect')
File "/usr/local/lib/python3.7/dist-packages/torch/nn/functional.py", line 3567, in _pad
assert len(pad) == 4, '4D tensors expect 4 values for padding'
AssertionError: 4D tensors expect 4 values for padding
我的解答思路和尝试过的方法
我追踪了tensor大小
data_utils.py.get_audio()中的原始audio:
torch.Size([69506, 2])
data_utils.py.get_audio()中经过unsqueeze(0)修改的audio_norm:
torch.Size([1, 69506, 2])
mel_processing.py.spectrogram_torch()中放入pad()前的y.unsqueeze(1):
torch.Size([1, 1, 69506, 2])
padding大小和预设config相同((1024-256)/2):
(384,384)
我想要达到的结果
原始代码我没修改过应该都没问题
是我输入的wav音频有问题?
