A Type-Token Identity in the Simon-Yule Model of Text.

Chen, Ye-Sho; Leimkuhler, Ferdinand F.

Notes FAQ Contact Us

Back to results

Peer reviewed

ERIC Number: EJ387483

Record Type: Journal

Publication Date: 1989

Pages: N/A

Abstractor: N/A

ISBN: N/A

ISSN: N/A

EISSN: N/A

Available Date: N/A

A Type-Token Identity in the Simon-Yule Model of Text.

Chen, Ye-Sho; Leimkuhler, Ferdinand F.

Journal of the American Society for Information Science, v40 n1 p45-53 Jan 1989

Establishes a type-token identity relating type-token ratio and bilogarithmic type-token ratio; uses the Simon-Yule model of Zipf's law to drive the type-token ratio and provide a statistical model of text generation; and refines the model to allow for decreasing entry rates of new words. (26 references) (Author/CLB)

Descriptors: Computational Linguistics, Mathematical Linguistics, Models, Proof (Mathematics), Statistical Distributions, Tables (Data)

Publication Type: Journal Articles; Reports - Research

Education Level: N/A

Audience: N/A

Language: English

Sponsor: N/A

Authoring Institution: N/A

Grant or Contract Numbers: N/A

Author Affiliations: N/A