Skip to content

Fix non-matching tensor with odd embedding size.#54

Open
zmy wants to merge 1 commit intocodertimo:masterfrom
zmy:master
Open

Fix non-matching tensor with odd embedding size.#54
zmy wants to merge 1 commit intocodertimo:masterfrom
zmy:master

Conversation

@zmy
Copy link

@zmy zmy commented Jan 26, 2019

If d_model integer parameter is odd rather than even, then tensor size is not matching (by a difference of 1) on the left and right sides of the assignment:

pe[:, 1::2] = torch.cos(position * div_term)

This pull request fixes the problem.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

1 participant