Beomjin ai #50
Merged
Beomjin ai #50
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
#38 문장의 길이의 최대는 200을 넘어가고 평균은 20이라서 문장의 길이가 50이 넘어가는 문장들은 버리는 작업을 수행
#38 50 이상의 문장을 걸러낸 후 모든 문장을 50으로 패딩 진행
#38 토큰들 간의 유사도를 알아내기 위해 Word2Vec 과정 추가
#38 토큰의 수가 50이 넘는 문장 제거하고 word2vec 재수행
방언 문장과 표준어 문장의 각각 토큰 수가 다르다는 것을 까먹고 각각 필터링을 해서 문장의 수가 달랐던 것을 수정
전 커밋과 동일
정수화를 한 데이터를 이용해 패딩 진행
40으로 변경
모델의 성능을 개선시키기 위해 CNN 모델과 LSTM 모델을 결합하여 학습하려 헀는데 현재 데이터의 차원 문제를 해결하지 못함
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.