How do I insert punctuation in unpunctuated text?

5 次查看（过去 30 天）

r r 2018-1-22

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/378298-how-do-i-insert-punctuation-in-unpunctuated-text

评论： r r 2018-1-22

Hi all,

I am currently working on a very fun project, but unfortunately came across a problem I haven't been able to solve for some time. What I am trying to do is punctuate text that contains no punctuation. At the time of writing I have a lot of text files that contain proper punctuation, and matching text files without punctuation.

Initially, I thought that Matlab would have some Neural Network that I could train with the input and output files I have but no, unfortunately not.

Therefor I am reaching out to you and hope there is someone who can help me punctuate unpunctuated text.

8 个评论
显示 6更早的评论隐藏 6更早的评论

r r 2018-1-22

@Jan Simon:

The input is a txt file without punctuation:

What s happened to me he thought it wasn t a dream his room a proper human room although a little too small lay peacefully between its four familiar walls a collection of textile samples lay spread out on the table samsa was a travelling salesman and above it there hung a picture that he had recently cut out of an illustrated magazine and housed in a nice, gilded frame it showed a lady fitted out with a fur hat and fur boa who sat upright raising a heavy fur muff that covered the whole of her lower arm towards the viewer

The output has to be the input with punctuation:

What's happened to me? he thought. It wasn't a dream. His room, a proper human room although a little too small, lay peacefully between its four familiar walls. A collection of textile samples lay spread out on the table - Samsa was a travelling salesman - and above it there hung a picture that he had recently cut out of an illustrated magazine and housed in a nice, gilded frame. It showed a lady fitted out with a fur hat and fur boa who sat upright, raising a heavy fur muff that covered the whole of her lower arm towards the viewer.

Guillaume 2018-1-22

No neural network is going to be able to say which is more correct of:

What's happened to me? He thought. It wasn't a dream.

"What's happened to me?", he thought. It wasn't a dream.

What's happened to me? He thought it wasn't a dream.

Without a ton of context no human can do that either. And even with context, it can still be ambiguous.

The traditional example:

Eats shoots and leaves. (Panda)

Eats, shoots, and leaves. (Gunman)

r r 2018-1-22

I don't need it to say if it's correct, all it needs to do is put some punctuation in and I will make a table containing all those entries. I will then compare this table with a table I've made of the original text and compare the two tables.

I've heard that this problem is more suitable for deep LSMT. But I have no idea how to implement this with Matlab. Do you maybe know how to implement this?

请先登录，再进行评论。

请先登录，再回答此问题。