[ShawnReynolds]

Is it possible to crawl a word document, for certain symbols or words? If so I would like to know how, I am currently writing a story, and I am trying to limit how many times I use certain words and symbols.

Thanks,
Vallex Koten

EDIT: I know I could just use CTRL+F, but it would be a pain to keep pressing those buttons for each different word and symbol.

[Psycho_Coder]

Give an example of what you wanna do.

What I understand, based on that I can tell the following :-

You can simply open the file and split the text into word and then count the words or find duplicate frequency.



Suppose I have a file Apple.txt with more than 500 words.

First I will have to Split the document to get individual words. So for what we can use split(), I am using Python to give you can example.

Here's the content of Apple.txt

Code:

The apple is the pomaceous fruit of the apple tree, Malus domestica of the rose family (Rosaceae). It is one of the most widely cultivated tree fruits, and the most widely known of the many members of genus Malus that are used by humans. Apples grow on deciduous trees which are large if grown from seed, but small if grafted onto roots (rootstock). The tree originated in Central Asia, where its wild ancestor, Malus sieversii, is still found today. Apples have been grown for thousands of years in Asia and Europe, and were brought to North America by European colonists. Apples have been present in the mythology and religions of many cultures, including Norse, Greek and Christian traditions. In 2010, the fruit's genome was decoded as part of research on disease control and selective breeding in apple production. There are more than 7,500 known cultivars of apples, resulting in a range of desired characteristics. Different cultivars are bred for various tastes and uses, including cooking, fresh eating and cider production. Domestic apples are generally propagated by grafting, although wild apples grow readily from seed. Trees are prone to a number of fungal, bacterial and pest problems, which can be controlled by a number of organic and non-organic means. About 69million tons of apples were grown worldwide in 2010, and China produced almost half of this total. The United States is the second-leading producer, with more than 6% of world production. Turkey is third, followed by Italy, India and Poland. Apples are often eaten raw, but can also be found in many prepared foods (especially desserts) and drinks. Many beneficial health effects are thought to result from eating apples; however, two forms of allergies are seen to various proteins found in the fruit. The apple is a deciduous tree, generally standing 1.8 to 4.6m (6 to 15ft) tall in cultivation and up to 39ft (12m) in the wild.[3] When cultivated, the size, shape and branch density is determined by rootstock selection and trimming method. The leaves are alternately arranged dark green-colored simple ovals with serrated margins and slightly downy undersides.[4] Blossoms are produced in spring simultaneously with the budding of the leaves, and are produced on spurs and some long shoots. The 3 to 4cm (1.2 to 1.6in) flowers are white with a pink tinge that gradually fades, five petaled, with an inflorescence consisting of a cyme with 46 flowers. The central flower of the inflorescence is called the "king bloom"; it opens first, and can develop a larger fruit.[4][5] The fruit matures in autumn, and varieties exist with a wide range of sizes. Commercial growers aim to produce an apple that is 7.0 to 8.3cm (2.75 to 3.25in) in diameter, due to market preference. Some consumers, especially those in Japan, prefer a larger apple, while apples below 5.7cm (2.25in) are generally used for making juice and have little fresh market value. The skin of ripe apples is generally red, yellow, green or pink, although many bi- or tri-colored varieties may be found.[6] The skin may also be wholly or partly russeted i.e. rough and brown. The skin is covered in a protective layer of epicuticular wax,[7] The flesh is generally pale yellowish-white,[6] though pink or yellow flesh is also known. The original wild ancestor of Malus domestica was Malus sieversii, found growing wild in the mountains of Central Asia in southern Kazakhstan, Kyrgyzstan, Tajikistan, and Xinjiang, China.[4][8] Cultivation of the species, most likely beginning on the forested flanks of the Tian Shan mountains, progressed over a long period of time and permitted secondary introgression of genes from other species into the open-pollinated seeds. Significant exchange with Malus sylvestris, the crabapple, resulted in current populations of apples to be more related to crabapples than to the more morphologically similar progenitor Malus sieversii. In strains without recent admixture the contribution of the latter predominates.[9] In 2010, an Italian-led consortium announced they had decoded the complete genome of the apple in collaboration with horticultural genomicists at Washington State University, using the Golden delicious variety. It had about 57,000 genes, the highest number of any plant genome studied to date and more genes than the human genome (about 30,000). This new understanding of the apple genome will help scientists in identifying genes and gene variants that contribute to resistance to disease and drought, and other desirable characteristics. Understanding the genes behind these characteristics will allow scientists to perform more knowledgeable selective breeding. Decoding the genome also provided proof that Malus sieversii was the wild ancestor of the domestic applean issue that had been long-debated in the scientific community. The center of diversity of the genus Malus is in eastern Turkey. The apple tree was perhaps the earliest tree to be cultivated, and its fruits have been improved through selection over thousands of years. Alexander the Great is credited with finding dwarfed apples in Kazakhstan in Asia in 328 BCE;[4] those he brought back to Macedonia might have been the progenitors of dwarfing root stocks. Winter apples, picked in late autumn and stored just above freezing, have been an important food in Asia and Europe for millennia. Apples were brought to North America by colonists in the 17th century,[4] and the first apple orchard on the North American continent was planted in Boston by Reverend William Blaxton in 1625. The only apples native to North America are crab apples, which were once called "common apples". Apple varieties brought as seed from Europe were spread along Native American trade routes, as well as being cultivated on Colonial farms. An 1845 United States apples nursery catalogue sold 350 of the "best" varieties, showing the proliferation of new North American varieties by the early 19th century. In the 20th century, irrigation projects in Eastern Washington began and allowed the development of the multibillion dollar fruit industry, of which the apple is the leading product.[4] Until the 20th century, farmers stored apples in frostproof cellars during the winter for their own use or for sale. Improved transportation of fresh apples by train and road replaced the necessity for storage. In the 21st century, long-term storage again came into popularity, as "controlled atmosphere" facilities were used to keep apples fresh year-round. Controlled atmosphere facilities use high humidity and low oxygen and carbon dioxide levels to maintain fruit freshness. In Norse mythology, the goddess Iunn is portrayed in the Prose Edda (written in the 13th century by Snorri Sturluson) as providing apples to the gods that give them eternal youthfulness. English scholar H. R. Ellis Davidson links apples to religious practices in Germanic paganism, from which Norse paganism developed. She points out that buckets of apples were found in the Oseberg ship burial site in Norway, and that fruit and nuts (Iunn having been described as being transformed into a nut in Skldskaparml) have been found in the early graves of the Germanic peoples in England and elsewhere on the continent of Europe, which may have had a symbolic meaning, and that nuts are still a recognized symbol of fertility in southwest England. Davidson notes a connection between apples and the Vanir, a tribe of gods associated with fertility in Norse mythology, citing an instance of eleven "golden apples" being given to woo the beautiful Gerr by Skrnir, who was acting as messenger for the major Vanir god Freyr in stanzas 19 and 20 of Skrnisml. Davidson also notes a further connection between fertility and apples in Norse mythology in chapter 2 of the Vlsunga saga when the major goddess Frigg sends King Rerir an apple after he prays to Odin for a child, Frigg's messenger (in the guise of a crow) drops the apple in his lap as he sits atop a mound. Rerir's wife's consumption of the apple results in a six-year pregnancy and the Caesarean section birth of their sonthe hero Vlsung. Further, Davidson points out the "strange" phrase "Apples of Hel" used in an 11th-century poem by the skald Thorbiorn Brnarson. She states this may imply that the apple was thought of by Brnarson as the food of the dead. Further, Davidson notes that the potentially Germanic goddess Nehalennia is sometimes depicted with apples and that parallels exist in early Irish stories. Davidson asserts that while cultivation of the apple in Northern Europe extends back to at least the time of the Roman Empire and came to Europe from the Near East, the native varieties of apple trees growing in Northern Europe are small and bitter. Davidson concludes that in the figure of Iunn "we must have a dim reflection of an old symbol: that of the guardian goddess of the life-giving fruit of the other world." Apples appear in many religious traditions, often as a mystical or forbidden fruit. One of the problems identifying apples in religion, mythology and folktales is that the word "apple" was used as a generic term for all (foreign) fruit, other than berries, including nuts, as late as the 17th century. For instance, in Greek mythology, the Greek hero Heracles, as a part of his Twelve Labours, was required to travel to the Garden of the Hesperides and pick the golden apples off the Tree of Life growing at its center. The Greek goddess of discord, Eris, became disgruntled after she was excluded from the wedding of Peleus and Thetis. In retaliation, she tossed a golden apple inscribed (Kalliste, sometimes transliterated Kallisti, 'For the most beautiful one'), into the wedding party. Three goddesses claimed the apple: Hera, Athena, and Aphrodite. Paris of Troy was appointed to select the recipient. After being bribed by both Hera and Athena, Aphrodite tempted him with the most beautiful woman in the world, Helen of Sparta. He awarded the apple to Aphrodite, thus indirectly causing the Trojan War. The apple was thus considered, in ancient Greece, to be sacred to Aphrodite, and to throw an apple at someone was to symbolically declare one's love; and similarly, to catch it was to symbolically show one's acceptance of that love. An epigram claiming authorship by Plato states: I throw the apple at you, and if you are willing to love me, take it and share your girlhood with me; but if your thoughts are what I pray they are not, even then take it, and consider how short-lived is beauty. Atalanta, also of Greek mythology, raced all her suitors in an attempt to avoid marriage. She outran all but Hippomenes (also known as Melanion, a name possibly derived from melon the Greek word for both "apple" and fruit in general), who defeated her by cunning, not speed. Hippomenes knew that he could not win in a fair race, so he used three golden apples (gifts of Aphrodite, the goddess of love) to distract Atalanta. It took all three apples and all of his speed, but Hippomenes was finally successful, winning the race and Atalanta's hand. Though the forbidden fruit of Eden in the Book of Genesis is not identified, popular Christian tradition has held that it was an apple that Eve coaxed Adam to share with her. The origin of the popular identification with a fruit unknown in the Middle East in biblical times is found in confusion between the Latin words mlum (an apple) and mlum (an evil), each of which is normally written malum. The tree of the forbidden fruit is called "the tree of the knowledge of good and evil" in Genesis 2:17, and the Latin for "good and evil" is bonum et malum. Renaissance painters may also have been influenced by the story of the golden apples in the Garden of Hesperides. As a result, in the story of Adam and Eve, the apple became a symbol for knowledge, immortality, temptation, the fall of man into sin, and sin itself. The larynx in the human throat has been called Adam's apple because of a notion that it was caused by the forbidden fruit remaining in the throat of Adam. The apple as symbol of sexual seduction has been used to imply human sexuality, possibly in an ironic vein. There are more than 7,500 known cultivars of apples. Cultivars vary in their yield and the ultimate size of the tree, even when grown on the same rootstock. Different cultivars are available for temperate and subtropical climates. The UK's National Fruit Collection, which is the responsibility of the Department of Environment Food and Rural Affairs, has a collection of over 2,000 accessions in Kent. The University of Reading, which is responsible for developing the UK national collection database, provides access to search the national collection. The University of Reading's work is part of the European Cooperative Programme for Plant Genetic Resources of which there are 38 countries participating in the Malus/Pyrus work group. The UK's national fruit collection database contains a wealth of information on the characteristics and origin of many apples, including alternative names for what is essentially the same 'genetic' apple variety. Most of these cultivars are bred for eating fresh (dessert apples), though some are cultivated specifically for cooking (cooking apples) or producing cider. Cider apples are typically too tart and astringent to eat fresh, but they give the beverage a rich flavor that dessert apples cannot. Commercially popular apple cultivars are soft but crisp. Other desired qualities in modern commercial apple breeding are a colorful skin, absence of russeting, ease of shipping, lengthy storage ability, high yields, disease resistance, common apple shape, and developed flavor. Modern apples are generally sweeter than older cultivars, as popular tastes in apples have varied over time. Most North Americans and Europeans favor sweet, subacid apples, but tart apples have a strong minority following. Extremely sweet apples with barely any acid flavor are popular in Asia and especially India. Old cultivars are often oddly shaped, russeted, and have a variety of textures and colors. Some find them to have a better flavor than modern cultivars, but may have other problems which make them commercially unviable from low yield, disease susceptibility, or poor tolerance for storage or transport. A few old cultivars are still produced on a large scale, but many have been preserved by home gardeners and farmers that sell directly to local markets. Many unusual and locally important cultivars with their own unique taste and appearance exist; apple conservation campaigns have sprung up around the world to preserve such local cultivars from extinction. In the United Kingdom, old cultivars such as 'Cox's Orange Pippin' and 'Egremont Russet' are still commercially important even though by modern standards they are low yielding and susceptible to disease.[4] In the wild, apples grow readily from seeds. However, like most perennial fruits, apples are ordinarily propagated asexually by grafting. This is because seedling apples are an example of "extreme heterozygotes", in that rather than inheriting DNA from their parents to create a new apple with those characteristics, they are instead significantly different from their parents. Triploid varieties have an additional reproductive barrier in that 3 sets of chromosomes cannot be divided evenly during meiosis, yielding unequal segregation of the chromosomes (aneuploids). Even in the case when a triploid plant can produce a seed (apples are an example), it occurs infrequently, and seedlings rarely survive. Because apples do not breed true when planted as seeds, grafting is generally used to produce new apple trees. The rootstock used for the bottom of the graft can be selected to produce trees of a large variety of sizes, as well as changing the winter hardiness, insect and disease resistance, and soil preference of the resulting tree. Dwarf rootstocks can be used to produce very small trees (less than 3.0m (10ft) high at maturity), which bear fruit earlier in their life cycle than full size trees. Dwarf rootstocks for apple trees can be traced as far back as 300 BC, to the area of Persia and Asia Minor. Alexander the Great sent samples of dwarf apple trees to Aristotle's Lyceum. Dwarf rootstocks became common by the 15th century, and later went through several cycles of popularity and decline throughout the world. The majority of the rootstocks used today to control size in apples were developed in England in the early 1900s. The East Malling Research Station conducted extensive research into rootstocks, and today their rootstocks are given an "M" prefix to designate their origin. Rootstocks marked with an "MM" prefix are Malling-series varieties later crossed with trees of the Northern Spy variety in Merton, England. Most new apple cultivars originate as seedlings, which either arise by chance or are bred by deliberately crossing cultivars with promising characteristics. The words 'seedling', 'pippin', and 'kernel' in the name of an apple cultivar suggest that it originated as a seedling. Apples can also form bud sports (mutations on a single branch). Some bud sports turn out to be improved strains of the parent cultivar. Some differ sufficiently from the parent tree to be considered new cultivars. Since the 1930s, the Excelsior Experiment Station at the University of Minnesota has introduced a steady progression of important apples that are widely grown, both commercially and by local orchardists, throughout Minnesota and Wisconsin. Its most important contributions have included 'Haralson' (which is the most widely cultivated apple in Minnesota), 'Wealthy', 'Honeygold', and 'Honeycrisp'. Apples have been acclimatized in Ecuador at very high altitudes, where they provide crops twice per year because of constant temperate conditions year-round. Apples are self-incompatible; they must cross-pollinate to develop fruit. During the flowering each season, apple growers often utilize pollinators to carry pollen. Honey bees are most commonly used. Orchard mason bees are also used as supplemental pollinators in commercial orchards. Bumblebee queens are sometimes present in orchards, but not usually in enough quantity to be significant pollinators. There are four to seven pollination groups in apples, depending on climate: One cultivar can be pollinated by a compatible cultivar from the same group or close (A with A, or A with B, but not A with C or D). Varieties are sometimes classified by the day of peak bloom in the average 30-day blossom period, with pollenizers selected from varieties within a 6-day overlap period. Cultivars vary in their yield and the ultimate size of the tree, even when grown on the same rootstock. Some cultivars, if left unpruned, will grow very large, which allows them to bear much more fruit, but makes harvesting very difficult. Depending on the tree density (number of trees planted per unit surface area), mature trees typically bear 40200kg (88441lb) of apples each year, though productivity can be close to zero in poor years. Apples are harvested using three-point ladders that are designed to fit amongst the branches. Trees grafted on dwarfing rootstocks will bear about 1080kg (22176lb) of fruit per year. Crops ripen at different times of the year according to the variety of apple. Varieties that yield their crop in the summer include Gala, Golden Supreme, McIntosh, Transparent, Primate, Sweet Bough, and Duchess; fall producers include Fuji, Jonagold, Golden Delicious, Red Delicious, Chenango, Gravenstein, Wealthy, McIntosh, Snow, and Blenheim; winter producers include Winesap, Granny Smith, King, Wagener, Swayzie, Greening, and Tolman Sweet. Commercially, apples can be stored for some months in controlled-atmosphere chambers to delay ethylene-induced ripening. Apples are commonly stored in chambers with higher concentrations of carbon dioxide and high air filtration. This prevents ethylene concentrations from rising to higher amounts and preventing ripening from occurring too quickly. Ripening continues when the fruit is removed from storage. For home storage, most varieties of apple can be held for approximately two weeks when kept at the coolest part of the refrigerator (i.e. below 5C). Some types, including the Granny Smith and Fuji, can be stored up to a year without significant degradation. Apple trees are susceptible to a number of fungal and bacterial diseases and insect pests. Many commercial orchards pursue an aggressive program of chemical sprays to maintain high fruit quality, tree health, and high yields. A trend in orchard management is the use of organic methods. These ban the use of some pesticides, though some older pesticides are allowed. Organic methods include, for instance, introducing its natural predator to reduce the population of a particular pest. A wide range of pests and diseases can affect the plant; three of the more common diseases/pests are mildew, aphids and apple scab. Among the most serious disease problems are fireblight, a bacterial disease; and Gymnosporangium rust, and black spot, two fungal diseases. Codling moths and apple maggots are two other pests which affect apple trees. Young apple trees are also prone to mammal pests like mice and deer, which feed on the soft bark of the trees, especially in winter. About 63 million tonnes of apples were grown worldwide in 2012, with China producing almost half of this total. The United States is the second-leading producer, with more than 6% of world production. The largest exporters of apples in 2009 were China, U.S., Turkey, Poland, Italy, Iran, and India while the biggest importers in the same year were Russia, Germany, the UK and the Netherlands. In the United States, more than 60% of all the apples sold commercially are grown in Washington. Imported apples from New Zealand and other more temperate areas are competing with U.S. production and increasing each year. Most of Australia's apple production is for domestic consumption. Imports from New Zealand have been disallowed under quarantine regulations for fireblight since 1921. Other countries with a significant production are Brazil, Argentina, Ukraine, Germany and South Africa. Apples are often eaten raw. The whole fruit including the skin is suitable for human consumption except for the seeds, which may affect some consumers. The core is often not eaten and is discarded. Varieties bred for raw consumption are termed dessert or table apples. Apples can be canned or juiced. They are milled or pressed to produce apple juice, which may be drunk unfiltered (called apple cider in North America), or filtered. The juice can be fermented to make cider (called hard cider in North America), ciderkin, and vinegar. Through distillation, various alcoholic beverages can be produced, such as applejack, Calvados, and apfelwein. Apple seed oil and pectin may also be produced. Apples are an important ingredient in many desserts, such as apple pie, apple crumble, apple crisp and apple cake. They are often eaten baked or stewed, and they can also be dried and eaten or reconstituted (soaked in water, alcohol or some other liquid) for later use. Pured apples are generally known as apple sauce. Apples are also made into apple butter and apple jelly. They are also used (cooked) in meat dishes. Sliced apples turn brown with exposure to air due to the conversion of natural phenolic substances into melanin upon exposure to oxygen. Different cultivars vary in their propensity to brown after slicing and the genetically engineered Arctic Apples do not brown. Sliced fruit can be treated with acidulated water to prevent this effect. Organic apples are commonly produced in the United States. Organic production is difficult in Europe, though a few orchards have done so with commercial success, using disease-resistant cultivars. A light coating of kaolin, which forms a physical barrier to some pests, also helps prevent apple sun scalding. One form of apple allergy, often found in northern Europe, is called birch-apple syndrome, and is found in people who are also allergic to birch pollen. Allergic reactions are triggered by a protein in apples that is similar to birch pollen, and people affected by this protein can also develop allergies to other fruits, nuts, and vegetables. Reactions, which entail oral allergy syndrome (OAS), generally involve itching and inflammation of the mouth and throat, but in rare cases can also include life-threatening anaphylaxis. This reaction only occurs when raw fruit is consumedthe allergen is neutralized in the cooking process. The variety of apple, maturity and storage conditions can change the amount of allergen present in individual fruits. Long storage times can increase the amount of proteins that cause birch-apple syndrome. In other areas, such as the Mediterranean, some individuals have adverse reactions to apples because of their similarity to peaches. This form of apple allergy also includes OAS, but often has more severe symptoms, such as vomiting, abdominal pain and urticaria, and can be life-threatening. Individuals with this form of allergy can also develop reactions to other fruits and nuts. Cooking does not break down the protein causing this particular reaction, so affected individuals can eat neither raw nor cooked apples. Freshly harvested, over-ripe fruits tend to have the highest levels of the protein that causes this reaction. Breeding efforts have yet to produce a hypoallergenic fruit suitable for either of the two forms of apple allergy. The seeds of apples contain small amounts of amygdalin, a sugar and cyanide compound known as a cyanogenic glycoside. Ingesting small amounts of apple seeds will cause no ill effects, but in extremely large doses can cause adverse reactions. There is only one known case of fatal cyanide poisoning from apple seeds; in this case the individual chewed and swallowed one cup of seeds. It may take several hours before the poison takes effect, as cyanogenic glycosides must be hydrolyzed before the cyanide ion is released. The proverb "An apple a day keeps the doctor away", addressing the health effects of the fruit, dates from 19th century Wales. According to the United States Department of Agriculture, a typical apple serving weighs 242 grams and contains 126 calories with significant dietary fiber and modest vitamin C content, with otherwise a generally low content of essential nutrients (table, right). Apple peels are a source of various phytochemicals with unknown nutritional value and possible antioxidant activity in vitro. The predominant phenolic phytochemicals in apples are quercetin, epicatechin, and procyanidin B2. Preliminary research suggests that nutrients and/or phytochemicals in apples may reduce the risk of colon cancer, prostate cancer and lung cancer. Apple peels contain ursolic acid which, in rat studies, increases skeletal muscle and brown fat, and decreases white fat, obesity, glucose intolerance, and fatty liver disease. Apple juice concentrate has been found in mice to increase the production of the neurotransmitter acetylcholine. Other studies have shown an "alleviation of oxidative damage and cognitive decline" in mice after the administration of apple juice. Fruit flies fed an apple extract lived 10% longer than other flies fed a normal diet. This article incorporates text from a publication now in the public domain:Ward, Artemas (1911). The Grocer's Encyclopedia.

Code:

a = open("Apple.txt", "r").split()

It will give me something like :-

Code:

['The', 'apple', 'is', 'the', 'pomaceous', 'fruit', 'of', 'the', 'apple', 'tree,', 'Malus', 'domestica', 'of', 'the', 'rose', 'family', '(Rosaceae).', 'It', 'is', 'one', 'of', 'the', 'most', 'widely', 'cultivated', 'tree', 'fruits,', 'and', 'the', 'most', 'widely', 'known', 'of', 'the', 'many', 'members', 'of', 'genus', 'Malus', 'that', 'are', 'used', 'by', 'humans.', 'Apples', 'grow', 'on', 'deciduous', 'trees', 'which', 'are', 'large', 'if', 'grown', 'from', 'seed,', 'but', 'small', 'if', 'grafted', 'onto', 'roots', '(rootstock).', 'The', 'tree', 'originated', 'in', 'Central', 'Asia,', 'where', 'its', 'wild', 'ancestor,', 'Malus', 'sieversii,', 'is', 'still', 'found', 'today.', 'Apples', 'have', 'been', 'grown', 'for', 'thousands', 'of', 'years', 'in', 'Asia', 'and', 'Europe,', 'and', 'were', 'brought', 'to', 'North', 'America', 'by', 'European', 'colonists.', 'Apples', 'have', 'been', 'present', 'in', 'the', 'mythology', 'and', 'religions', 'of', 'many', 'cultures,', 'including', 'Norse,', 'Greek', 'and', 'Christian', 'traditions.', 'In', '2010,', 'the', "fruit's", 'genome', 'was', 'decoded', 'as', 'part', 'of', 'research', 'on', 'disease', 'control', 'and', 'selective', 'breeding', 'in', 'apple', 'production.\nThere', 'are', 'more', 'than', '7,500', 'known', 'cultivars', 'of', 'apples,', 'resulting', 'in', 'a', 'range', 'of', 'desired', 'characteristics.', 'Different', 'cultivars', 'are', 'bred', 'for', 'various', 'tastes', 'and', 'uses,', 'including', 'cooking,', 'fresh', 'eating', 'and', 'cider', 'production.', 'Domestic', 'apples', 'are', 'generally', 'propagated', 'by', 'grafting,', 'although', 'wild', 'apples', 'grow', 'readily', 'from', 'seed.', 'Trees', 'are', 'prone', 'to', 'a', 'number', 'of', 'fungal,', 'bacterial', 'and', 'pest', 'problems,', 'which', 'can', 'be', 'controlled', 'by', 'a', 'number', 'of', 'organic', 'and', 'non-organic', 'means.\nAbout', '69million', 'tons', 'of', 'apples', 'were', 'grown', 'worldwide', 'in', '2010,', 'and', 'China', 'produced', 'almost', 'half', 'of', 'this', 'total.', 'The', 'United', 'States', 'is', 'the', 'second-leading', 'producer,', 'with', 'more', 'than', '6%', 'of', 'world', 'production.', 'Turkey', 'is', 'third,', 'followed', 'by', 'Italy,', 'India', 'and', 'Poland.', 'Apples', 'are', 'often', 'eaten', 'raw,', 'but', 'can', 'also', 'be', 'found', 'in', 'many', 'prepared', 'foods', '(especially', 'desserts)', 'and', 'drinks.', 'Many', 'beneficial', 'health', 'effects', 'are', 'thought', 'to', 'result', 'from', 'eating', 'apples;', 'however,', 'two', 'forms', 'of', 'allergies', 'are', 'seen', 'to', 'various', 'proteins', 'found', 'in', 'the', 'fruit.\n\n\nThe', 'apple', 'is', 'a', 'deciduous', 'tree,', 'generally', 'standing', '1.8', 'to', '4.6m', '(6', 'to', '15ft)', 'tall', 'in', 'cultivation', 'and', 'up', 'to', '39ft', '(12m)', 'in', 'the', 'wild.[3]', 'When', 'cultivated,', 'the', 'size,', 'shape', 'and', 'branch', 'density', 'is', 'determined', 'by', 'rootstock', 'selection', 'and', 'trimming', 'method.', 'The', 'leaves', 'are', 'alternately', 'arranged', 'dark', 'green-colored', 'simple', 'ovals', 'with', 'serrated', 'margins', 'and', 'slightly', 'downy', 'undersides.[4]\nBlossoms', 'are', 'produced', 'in', 'spring', 'simultaneously', 'with', 'the', 'budding', 'of', 'the', 'leaves,', 'and', 'are', 'produced', 'on', 'spurs', 'and', 'some', 'long', 'shoots.', 'The', '3', 'to', '4cm', '(1.2', 'to', '1.6in)', 'flowers', 'are', 'white', 'with', 'a', 'pink', 'tinge', 'that', 'gradually', 'fades,', 'five', 'petaled,', 'with', 'an', 'inflorescence', 'consisting', 'of', 'a', 'cyme', 'with', '46', 'flowers.', 'The', 'central', 'flower', 'of', 'the', 'inflorescence', 'is', 'called', 'the', '"king', 'bloom";', 'it', 'opens', 'first,', 'and', 'can', 'develop', 'a', 'larger', 'fruit.[4][5]\nThe', 'fruit', 'matures', 'in', 'autumn,', 'and', 'varieties', 'exist', 'with', 'a', 'wide', 'range', 'of', 'sizes.', 'Commercial', 'growers', 'aim', 'to', 'produce', 'an', 'apple', 'that', 'is', '7.0', 'to', '8.3cm', '(2.75', 'to', '3.25in)', 'in', 'diameter,', 'due', 'to', 'market', 'preference.', 'Some', 'consumers,', 'especially', 'those', 'in', 'Japan,', 'prefer', 'a', 'larger', 'apple,', 'while', 'apples', 'below', '5.7cm', '(2.25in)', 'are', 'generally', 'used', 'for', 'making', 'juice', 'and', 'have', 'little', 'fresh', 'market', 'value.', 'The', 'skin', 'of', 'ripe', 'apples', 'is', 'generally', 'red,', 'yellow,', 'green', 'or', 'pink,', 'although', 'many', 'bi-', 'or', 'tri-colored', 'varieties', 'may', 'be', 'found.[6]', 'The', 'skin', 'may', 'also', 'be', 'wholly', 'or', 'partly', 'russeted', 'i.e.', 'rough', 'and', 'brown.', 'The', 'skin', 'is', 'covered', 'in', 'a', 'protective', 'layer', 'of', 'epicuticular', 'wax,[7]', 'The', 'flesh', 'is', 'generally', 'pale', 'yellowish-white,[6]', 'though', 'pink', 'or', 'yellow', 'flesh', 'is', 'also', 'known.\nThe', 'original', 'wild', 'ancestor', 'of', 'Malus', 'domestica', 'was', 'Malus', 'sieversii,', 'found', 'growing', 'wild', 'in', 'the', 'mountains', 'of', 'Central', 'Asia', 'in', 'southern', 'Kazakhstan,', 'Kyrgyzstan,', 'Tajikistan,', 'and', 'Xinjiang,', 'China.[4][8]', 'Cultivation', 'of', 'the', 'species,', 'most', 'likely', 'beginning', 'on', 'the', 'forested', 'flanks', 'of', 'the', 'Tian', 'Shan', 'mountains,', 'progressed', 'over', 'a', 'long', 'period', 'of', 'time', 'and', 'permitted', 'secondary', 'introgression', 'of', 'genes', 'from', 'other', 'species', 'into', 'the', 'open-pollinated', 'seeds.', 'Significant', 'exchange', 'with', 'Malus', 'sylvestris,', 'the', 'crabapple,', 'resulted', 'in', 'current', 'populations', 'of', 'apples', 'to', 'be', 'more', 'related', 'to', 'crabapples', 'than', 'to', 'the', 'more', 'morphologically', 'similar', 'progenitor', 'Malus', 'sieversii.', 'In', 'strains', 'without', 'recent', 'admixture', 'the', 'contribution', 'of', 'the', 'latter', 'predominates.[9]\nIn', '2010,', 'an', 'Italian-led', 'consortium', 'announced', 'they', 'had', 'decoded', 'the', 'complete', 'genome', 'of', 'the', 'apple', 'in', 'collaboration', 'with', 'horticultural', 'genomicists', 'at', 'Washington', 'State', 'University,', 'using', 'the', 'Golden', 'delicious', 'variety.', 'It', 'had', 'about', '57,000', 'genes,', 'the', 'highest', 'number', 'of', 'any', 'plant', 'genome', 'studied', 'to', 'date', 'and', 'more', 'genes', 'than', 'the', 'human', 'genome', '(about', '30,000).', 'This', 'new', 'understanding', 'of', 'the', 'apple', 'genome', 'will', 'help', 'scientists', 'in', 'identifying', 'genes', 'and', 'gene', 'variants', 'that', 'contribute', 'to', 'resistance', 'to', 'disease', 'and', 'drought,', 'and', 'other', 'desirable', 'characteristics.', 'Understanding', 'the', 'genes', 'behind', 'these', 'characteristics', 'will', 'allow', 'scientists', 'to', 'perform', 'more', 'knowledgeable', 'selective', 'breeding.', 'Decoding', 'the', 'genome', 'also', 'provided', 'proof', 'that', 'Malus', 'sieversii', 'was', 'the', 'wild', 'ancestor', 'of', 'the', 'domestic', 'applean', 'issue', 'that', 'had', 'been', 'long-debated', 'in', 'the', 'scientific', 'community.\nThe', 'center', 'of', 'diversity', 'of', 'the', 'genus', 'Malus', 'is', 'in', 'eastern', 'Turkey.', 'The', 'apple', 'tree', 'was', 'perhaps', 'the', 'earliest', 'tree', 'to', 'be', 'cultivated,', 'and', 'its', 'fruits', 'have', 'been', 'improved', 'through', 'selection', 'over', 'thousands', 'of', 'years.', 'Alexander', 'the', 'Great', 'is', 'credited', 'with', 'finding', 'dwarfed', 'apples', 'in', 'Kazakhstan', 'in', 'Asia', 'in', '328', 'BCE;[4]', 'those', 'he', 'brought', 'back', 'to', 'Macedonia', 'might', 'have', 'been', 'the', 'progenitors', 'of', 'dwarfing', 'root', 'stocks.', 'Winter', 'apples,', 'picked', 'in', 'late', 'autumn', 'and', 'stored', 'just', 'above', 'freezing,', 'have', 'been', 'an', 'important', 'food', 'in', 'Asia', 'and', 'Europe', 'for', 'millennia.\nApples', 'were', 'brought', 'to', 'North', 'America', 'by', 'colonists', 'in', 'the', '17th', 'century,[4]', 'and', 'the', 'first', 'apple', 'orchard', 'on', 'the', 'North', 'American', 'continent', 'was', 'planted', 'in', 'Boston', 'by', 'Reverend', 'William', 'Blaxton', 'in', '1625.', 'The', 'only', 'apples', 'native', 'to', 'North', 'America', 'are', 'crab', 'apples,', 'which', 'were', 'once', 'called', '"common', 'apples".', 'Apple', 'varieties', 'brought', 'as', 'seed', 'from', 'Europe', 'were', 'spread', 'along', 'Native', 'American', 'trade', 'routes,', 'as', 'well', 'as', 'being', 'cultivated', 'on', 'Colonial', 'farms.', 'An', '1845', 'United', 'States', 'apples', 'nursery', 'catalogue', 'sold', '350', 'of', 'the', '"best"', 'varieties,', 'showing', 'the', 'proliferation', 'of', 'new', 'North', 'American', 'varieties', 'by', 'the', 'early', '19th', 'century.', 'In', 'the', '20th', 'century,', 'irrigation', 'projects', 'in', 'Eastern', 'Washington', 'began', 'and', 'allowed', 'the', 'development', 'of', 'the', 'multibillion', 'dollar', 'fruit', 'industry,', 'of', 'which', 'the', 'apple', 'is', 'the', 'leading', 'product.[4]\nUntil', 'the', '20th', 'century,', 'farmers', 'stored', 'apples', 'in', 'frostproof', 'cellars', 'during', 'the', 'winter', 'for', 'their', 'own', 'use', 'or', 'for', 'sale.', 'Improved', 'transportation', 'of', 'fresh', 'apples', 'by', 'train', 'and', 'road', 'replaced', 'the', 'necessity', 'for', 'storage.', 'In', 'the', '21st', 'century,', 'long-term', 'storage', 'again', 'came', 'into', 'popularity,', 'as', '"controlled', 'atmosphere"', 'facilities', 'were', 'used', 'to', 'keep', 'apples', 'fresh', 'year-round.', 'Controlled', 'atmosphere', 'facilities', 'use', 'high', 'humidity', 'and', 'low', 'oxygen', 'and', 'carbon', 'dioxide', 'levels', 'to', 'maintain', 'fruit', 'freshness.\nIn', 'Norse', 'mythology,', 'the', 'goddess', 'Iunn', 'is', 'portrayed', 'in', 'the', 'Prose', 'Edda', '(written', 'in', 'the', '13th', 'century', 'by', 'Snorri', 'Sturluson)', 'as', 'providing', 'apples', 'to', 'the', 'gods', 'that', 'give', 'them', 'eternal', 'youthfulness.', 'English', 'scholar', 'H.', 'R.', 'Ellis', 'Davidson', 'links', 'apples', 'to', 'religious', 'practices', 'in', 'Germanic', 'paganism,', 'from', 'which', 'Norse', 'paganism', 'developed.', 'She', 'points', 'out', 'that', 'buckets', 'of', 'apples', 'were', 'found', 'in', 'the', 'Oseberg', 'ship', 'burial', 'site', 'in', 'Norway,', 'and', 'that', 'fruit', 'and', 'nuts', '(Iunn', 'having', 'been', 'described', 'as', 'being', 'transformed', 'into', 'a', 'nut', 'in', 'Skldskaparml)', 'have', 'been', 'found', 'in', 'the', 'early', 'graves', 'of', 'the', 'Germanic', 'peoples', 'in', 'England', 'and', 'elsewhere', 'on', 'the', 'continent', 'of', 'Europe,', 'which', 'may', 'have', 'had', 'a', 'symbolic', 'meaning,', 'and', 'that', 'nuts', 'are', 'still', 'a', 'recognized', 'symbol', 'of', 'fertility', 'in', 'southwest', 'England.\nDavidson', 'notes', 'a', 'connection', 'between', 'apples', 'and', 'the', 'Vanir,', 'a', 'tribe', 'of', 'gods', 'associated', 'with', 'fertility', 'in', 'Norse', 'mythology,', 'citing', 'an', 'instance', 'of', 'eleven', '"golden', 'apples"', 'being', 'given', 'to', 'woo', 'the', 'beautiful', 'Gerr', 'by', 'Skrnir,', 'who', 'was', 'acting', 'as', 'messenger', 'for', 'the', 'major', 'Vanir', 'god', 'Freyr', 'in', 'stanzas', '19', 'and', '20', 'of', 'Skrnisml.', 'Davidson', 'also', 'notes', 'a', 'further', 'connection', 'between', 'fertility', 'and', 'apples', 'in', 'Norse', 'mythology', 'in', 'chapter', '2', 'of', 'the', 'Vlsunga', 'saga', 'when', 'the', 'major', 'goddess', 'Frigg', 'sends', 'King', 'Rerir', 'an', 'apple', 'after', 'he', 'prays', 'to', 'Odin', 'for', 'a', 'child,', "Frigg's", 'messenger', '(in', 'the', 'guise', 'of', 'a', 'crow)', 'drops', 'the', 'apple', 'in', 'his', 'lap', 'as', 'he', 'sits', 'atop', 'a', 'mound.', "Rerir's", "wife's", 'consumption', 'of', 'the', 'apple', 'results', 'in', 'a', 'six-year', 'pregnancy', 'and', 'the', 'Caesarean', 'section', 'birth', 'of', 'their', 'sonthe', 'hero', 'Vlsung.\nFurther,', 'Davidson', 'points', 'out', 'the', '"strange"', 'phrase', '"Apples', 'of', 'Hel"', 'used', 'in', 'an', '11th-century', 'poem', 'by', 'the', 'skald', 'Thorbiorn', 'Brnarson.', 'She', 'states', 'this', 'may', 'imply', 'that', 'the', 'apple', 'was', 'thought', 'of', 'by', 'Brnarson', 'as', 'the', 'food', 'of', 'the', 'dead.', 'Further,', 'Davidson', 'notes', 'that', 'the', 'potentially', 'Germanic', 'goddess', 'Nehalennia', 'is', 'sometimes', 'depicted', 'with', 'apples', 'and', 'that', 'parallels', 'exist', 'in', 'early', 'Irish', 'stories.', 'Davidson', 'asserts', 'that', 'while', 'cultivation', 'of', 'the', 'apple', 'in', 'Northern', 'Europe', 'extends', 'back', 'to', 'at', 'least', 'the', 'time', 'of', 'the', 'Roman', 'Empire', 'and', 'came', 'to', 'Europe', 'from', 'the', 'Near', 'East,', 'the', 'native', 'varieties', 'of', 'apple', 'trees', 'growing', 'in', 'Northern', 'Europe', 'are', 'small', 'and', 'bitter.', 'Davidson', 'concludes', 'that', 'in', 'the', 'figure', 'of', 'Iunn', '"we', 'must', 'have', 'a', 'dim', 'reflection', 'of', 'an', 'old', 'symbol:', 'that', 'of', 'the', 'guardian', 'goddess', 'of', 'the', 'life-giving', 'fruit', 'of', 'the', 'other', 'world."\nApples', 'appear', 'in', 'many', 'religious', 'traditions,', 'often', 'as', 'a', 'mystical', 'or', 'forbidden', 'fruit.', 'One', 'of', 'the', 'problems', 'identifying', 'apples', 'in', 'religion,', 'mythology', 'and', 'folktales', 'is', 'that', 'the', 'word', '"apple"', 'was', 'used', 'as', 'a', 'generic', 'term', 'for', 'all', '(foreign)', 'fruit,', 'other', 'than', 'berries,', 'including', 'nuts,', 'as', 'late', 'as', 'the', '17th', 'century.', 'For', 'instance,', 'in', 'Greek', 'mythology,', 'the', 'Greek', 'hero', 'Heracles,', 'as', 'a', 'part', 'of', 'his', 'Twelve', 'Labours,', 'was', 'required', 'to', 'travel', 'to', 'the', 'Garden', 'of', 'the', 'Hesperides', 'and', 'pick', 'the', 'golden', 'apples', 'off', 'the', 'Tree', 'of', 'Life', 'growing', 'at', 'its', 'center.\nThe', 'Greek', 'goddess', 'of', 'discord,', 'Eris,', 'became', 'disgruntled', 'after', 'she', 'was', 'excluded', 'from', 'the', 'wedding', 'of', 'Peleus', 'and', 'Thetis.', 'In', 'retaliation,', 'she', 'tossed', 'a', 'golden', 'apple', 'inscribed', '', '(Kalliste,', 'sometimes', 'transliterated', 'Kallisti,', "'For", 'the', 'most', 'beautiful', "one'),", 'into', 'the', 'wedding', 'party.', 'Three', 'goddesses', 'claimed', 'the', 'apple:', 'Hera,', 'Athena,', 'and', 'Aphrodite.', 'Paris', 'of', 'Troy', 'was', 'appointed', 'to', 'select', 'the', 'recipient.', 'After', 'being', 'bribed', 'by', 'both', 'Hera', 'and', 'Athena,', 'Aphrodite', 'tempted', 'him', 'with', 'the', 'most', 'beautiful', 'woman', 'in', 'the', 'world,', 'Helen', 'of', 'Sparta.', 'He', 'awarded', 'the', 'apple', 'to', 'Aphrodite,', 'thus', 'indirectly', 'causing', 'the', 'Trojan', 'War.\nThe', 'apple', 'was', 'thus', 'considered,', 'in', 'ancient', 'Greece,', 'to', 'be', 'sacred', 'to', 'Aphrodite,', 'and', 'to', 'throw', 'an', 'apple', 'at', 'someone', 'was', 'to', 'symbolically', 'declare', "one's", 'love;', 'and', 'similarly,', 'to', 'catch', 'it', 'was', 'to', 'symbolically', 'show', "one's", 'acceptance', 'of', 'that', 'love.', 'An', 'epigram', 'claiming', 'authorship', 'by', 'Plato', 'states:\nI', 'throw', 'the', 'apple', 'at', 'you,', 'and', 'if', 'you', 'are', 'willing', 'to', 'love', 'me,', 'take', 'it', 'and', 'share', 'your', 'girlhood', 'with', 'me;', 'but', 'if', 'your', 'thoughts', 'are', 'what', 'I', 'pray', 'they', 'are', 'not,', 'even', 'then', 'take', 'it,', 'and', 'consider', 'how', 'short-lived', 'is', 'beauty.\nAtalanta,', 'also', 'of', 'Greek', 'mythology,', 'raced', 'all', 'her', 'suitors', 'in', 'an', 'attempt', 'to', 'avoid', 'marriage.', 'She', 'outran', 'all', 'but', 'Hippomenes', '(also', 'known', 'as', 'Melanion,', 'a', 'name', 'possibly', 'derived', 'from', 'melon', 'the', 'Greek', 'word', 'for', 'both', '"apple"', 'and', 'fruit', 'in', 'general),', 'who', 'defeated', 'her', 'by', 'cunning,', 'not', 'speed.', 'Hippomenes', 'knew', 'that', 'he', 'could', 'not', 'win', 'in', 'a', 'fair', 'race,', 'so', 'he', 'used', 'three', 'golden', 'apples', '(gifts', 'of', 'Aphrodite,', 'the', 'goddess', 'of', 'love)', 'to', 'distract', 'Atalanta.', 'It', 'took', 'all', 'three', 'apples', 'and', 'all', 'of', 'his', 'speed,', 'but', 'Hippomenes', 'was', 'finally', 'successful,', 'winning', 'the', 'race', 'and', "Atalanta's", 'hand.\nThough', 'the', 'forbidden', 'fruit', 'of', 'Eden', 'in', 'the', 'Book', 'of', 'Genesis', 'is', 'not', 'identified,', 'popular', 'Christian', 'tradition', 'has', 'held', 'that', 'it', 'was', 'an', 'apple', 'that', 'Eve', 'coaxed', 'Adam', 'to', 'share', 'with', 'her.', 'The', 'origin', 'of', 'the', 'popular', 'identification', 'with', 'a', 'fruit', 'unknown', 'in', 'the', 'Middle', 'East', 'in', 'biblical', 'times', 'is', 'found', 'in', 'confusion', 'between', 'the', 'Latin', 'words', 'mlum', '(an', 'apple)', 'and', 'mlum', '(an', 'evil),', 'each', 'of', 'which', 'is', 'normally', 'written', 'malum.', 'The', 'tree', 'of', 'the', 'forbidden', 'fruit', 'is', 'called', '"the', 'tree', 'of', 'the', 'knowledge', 'of', 'good', 'and', 'evil"', 'in', 'Genesis', '2:17,', 'and', 'the', 'Latin', 'for', '"good', 'and', 'evil"', 'is', 'bonum', 'et', 'malum.\nRenaissance', 'painters', 'may', 'also', ...... ...... So on ...............

But there is a problem since at many place we have strings like " \n" so it inaccurate. So what we can do is use a regex Splitter.

Code:

import re a = re.split(" |\n",open("Apple.txt", "r").read())

The above code will correct the initial mistake. Now what we have to get the frequency. For what we can import collections and use the Counter.

Code:

import collections print [x + " : " + str(y) for x, y in collections.Counter(a).items() if y > 1 ]

The above will give you all the words with a count greater than 1.

output :-

I have printed the list directly.

Code:

[' : 8', 'facilities : 2', 'prefix : 2', 'China : 2', 'affect : 3', 'second-leading : 2', 'even : 4', 'century, : 4', 'century. : 2', 'selected : 2', 'fruits, : 3', 'new : 6', 'suitable : 2', 'golden : 4', 'brought : 4', 'deciduous : 2', 'must : 3', 'word : 2', 'work : 2', 'give : 2', 'times : 3', 'nuts : 2', 'ancestor : 2', 'A : 6', 'after : 4', 'maintain : 2', 'ultimate : 2', 'origin : 2', 'over : 4', 'vary : 3', 'before : 2', 'production : 5', 'them : 4', 'affected : 2', 'diseases : 2', 'effects : 2', 'they : 8', 'India : 2', 'each : 4', 'phenolic : 2', 'barrier : 2', 'University : 3', 'commercially : 4', '(an : 2', 'Italy, : 2', 'sieversii, : 2', 'apple, : 2', 'malum. : 2', 'too : 2', 'Alexander : 2', 'McIntosh, : 2', 'domestica : 2', 'older : 2', 'tree : 9', 'modern : 3', 'raw : 3', 'seed : 3', 'Christian : 2', 'causing : 2', 'They : 3', 'though : 6', 'cultivars. : 2', 'cultivars, : 3', 'points : 2', 'came : 2', 'cooking : 2', 'European : 2', 'do : 2', 'wedding : 2', 'countries : 2', 'Washington : 2', 'fertility : 3', 'rootstock : 2', 'hero : 2', 'Dwarf : 3', 'propagated : 2', 'C : 2', 'Central : 2', 'fruits : 3', '(called : 2', 'carbon : 2', 'inflorescence : 2', 'goddess : 6', 'genus : 2', 'three : 3', 'been : 15', 'apples. : 3', 'apples, : 6', 'mlum : 2', 'phytochemicals : 3', 'air : 2', 'symbolically : 2', 'trees. : 3', 'is : 47', 'it : 7', 'in : 126', 'if : 5', 'grown : 7', 'make : 2', 'cyanogenic : 2', 'several : 2', 'Apples : 16', 'the : 217', 'gods : 2', 'human : 4', 'had : 4', 'has : 7', 'seeds, : 2', 'seeds. : 3', 'possibly : 2', 'old : 3', 'people : 2', 'for : 32', 'variety. : 2', 'production. : 4', 'total. : 2', 'was : 17', 'decoded : 2', 'form : 4', 'Golden : 3', 'bred : 4', 'exist : 2', 'when : 8', 'time : 2', 'skin : 4', 'brown : 3', 'prevent : 2', 'bacterial : 3', 'genes : 4', 'Europe, : 4', 'commonly : 3', 'market : 2', 'Athena, : 2', 'sports : 2', 'birch-apple : 2', 'today : 2', 'thousands : 2', 'can : 27', 'growing : 3', 'pink : 2', 'winter : 3', 'Fruit : 2', 'Germanic : 3', 'may : 11', 'produce : 7', 'such : 6', 'grow : 4', 'temperate : 3', 'natural : 2', 'varieties : 9', 'Cultivars : 2', 'so : 3', 'still : 4', 'forms : 3', 'year. : 2', 'She : 3', 'half : 2', 'not : 9', 'Malus : 9', 'name : 2', 'proteins : 2', 'Zealand : 2', 'year : 4', 'increase : 2', 'dioxide : 2', 'turn : 2', 'There : 4', 'Asia : 6', 'one : 3', 'size : 4', 'given : 2', 'fruit, : 3', 'fruit. : 3', 'white : 2', 'that : 34', 'than : 14', 'wide : 2', 'apples : 49', 'were : 11', 'Aphrodite, : 3', 'and : 143', 'tastes : 2', 'any : 2', 'take : 3', 'chromosomes : 2', 'especially : 3', 'later : 3', 'typically : 2', '3 : 2', 'only : 3', 'yield : 3', 'where : 2', 'farmers : 2', 'between : 3', 'parent : 2', 'originated : 2', 'many : 8', '6% : 2', 'those : 3', 'case : 3', 'these : 2', 'characteristics : 2', 'producer, : 2', 'protein : 4', 'develop : 4', 'same : 5', 'I : 2', 'producers : 2', 'fruit : 20', 'It : 4', 'without : 2', 'In : 11', 'United : 7', 'being : 4', 'flavor : 3', 'Many : 3', 'using : 3', 'identifying : 2', 'either : 2', 'New : 2', '2010, : 3', 'throw : 2', 'Further, : 2', 'on : 16', 'of : 174', 'concentrations : 2', 'or : 20', 'your : 2', 'her : 2', 'low : 4', 'mice : 3', 'with : 38', 'an : 22', 'as : 34', 'at : 10', 'orchards : 2', 'An : 2', 'storage : 5', 'pollen. : 2', 'poor : 2', 'Great : 2', 'Varieties : 3', 'symbol : 3', 'dwarfing : 2', 'important : 6', 'fresh : 5', 'storage. : 2', 'all : 6', 'forbidden : 4', 'allergy : 3', 'Station : 2', 'religious : 2', 'Trees : 2', 'to : 96', 'very : 4', 'fall : 2', '17th : 2', 'large : 4', 'small : 5', '20th : 2', 'East : 2', 'what : 2', 'Latin : 2', 'scientists : 2', 'selective : 2', 'amount : 2', 'readily : 2', 'Europe : 5', 'contains : 2', 'two : 5', 'cultivation : 2', 'more : 13', 'American : 3', 'particular : 2', 'known : 7', 'producing : 2', 'beautiful : 3', 'Different : 3', 'share : 2', 'plant : 2', 'different : 2', 'Davidson : 7', 'a : 66', 'brown. : 2', 'orchard : 2', 'developed : 2', 'held : 2', 'through : 2', 'its : 4', 'rootstock. : 2', 'pests : 3', 'susceptible : 2', 'late : 2', 'food : 2', 'found : 10', 'rootstocks : 6', 'reactions : 3', 'reduce : 2', 'America), : 2', 'research : 3', 'health : 2', 'occurs : 2', 'story : 2', 'cyanide : 3', 'major : 2', 'number : 4', 'Genesis : 2', 'instance, : 2', 'part : 4', 'well : 2', 'juice : 3', 'thought : 2', 'most : 11', 'significant : 4', 'The : 40', 'Iunn : 2', 'tree, : 4', 'peels : 2', 'grafted : 2', 'Fuji, : 2', 'his : 3', 'trees : 11', 'allergen : 2', 'during : 2', 'generally : 10', 'common : 3', 'For : 2', 'individual : 2', 'are : 73', 'close : 2', 'Delicious, : 2', 'various : 4', 'years. : 2', 'conditions : 2', 'sold : 2', 'both : 3', 'improved : 2', 'Greek : 6', 'connection : 2', 'became : 3', 'flies : 2', 'throughout : 2', 'due : 2', 'Most : 4', 'while : 3', 'century : 2', 'widely : 4', 'higher : 2', 'About : 2', 'used : 13', 'levels : 2', 'birch : 2', 'early : 4', 'cultivars : 14', 'world : 3', 'continent : 2', 'also : 20', 'characteristics. : 3', 'Sliced : 2', 'individuals : 2', 'nutrients : 2', 'popular : 5', 'often : 9', 'some : 9', 'back : 3', '7,500 : 2', 'per : 3', 'be : 28', 'eating : 3', 'fed : 2', 'by : 30', 'range : 3', 'eaten : 5', 'into : 8', 'few : 2', 'long : 2', 'up : 3', 'similar : 2', 'called : 5', 'sometimes : 4', 'year-round. : 2', 'amounts : 3', 'genome : 6', 'tart : 2', 'Organic : 3', 'problems : 3', 'insect : 2', 'resistance, : 2', 'evil" : 2', 'fungal : 2', 'Department : 2', 'include : 4', 'dessert : 2', 'notes : 3', 'imply : 2', 'acid : 2', 'growers : 2', '19th : 2', 'America : 3', 'commercial : 4', 'desired : 2', 'larger : 2', 'mythology, : 4', 'resulting : 2', 'apple : 63', 'use : 4', 'from : 25', 'consumption : 3', 'this : 9', 'control : 2', 'Northern : 3', 'high : 7', 'native : 2', 'collection : 3', 'England. : 2', 'Apple : 6', 'One : 3', 'Minnesota : 2', 'produced : 5', 'Adam : 2', 'day : 2', 'cider : 4', 'out : 3', 'adverse : 2', 'messenger : 2', 'cause : 3', "one's : 2", "UK's : 2", 'This : 6', 'organic : 2', 'North : 8', 'unknown : 2', 'their : 13', 'prone : 2', 'yielding : 2', 'Other : 3', 'have : 26', 'chambers : 2', 'throat : 2', 'allergies : 2', 'which : 20', 'Granny : 2', 'worldwide : 2', 'who : 3', 'Some : 6', 'disease : 6', 'selection : 2', 'Hippomenes : 3', 'planted : 3', 'local : 3', 'bear : 4', 'words : 2', 'she : 2', 'contain : 2', 'including : 6', 'national : 3', 'pollinators : 2', 'strains : 2', 'present : 3', 'will : 5', 'wild : 5', 'mythology : 3', 'almost : 2', 'thus : 2', 'Garden : 2', 'cultivar : 3', 'Norse : 4', 'States : 4', 'flesh : 2', 'domestic : 2', 'fat, : 2', 'stored : 5', 'density : 2', 'England : 2', 'like : 2', 'soft : 2', 'because : 4', '"apple" : 2', 'home : 2', 'cultivated, : 2', 'nuts, : 2', 'although : 2', 'about : 2', 'seeds : 2', 'UK : 2', 'own : 2', 'cultivated : 4', 'bees : 2', 'breeding : 2', 'but : 16', 'highest : 2', 'eat : 2', 'bud : 2', 'he : 5', 'below : 2', 'variety : 5', 'other : 12', 'exposure : 2']

if you plot the values then you will get something like this one :- (for all the values obtained above)





I plotted the values in range from 100 - 120 and it look like :-

[Deque]

Good answer from @Psycho_Coder
Additionally you have to take into account that the format of office documents is a bit more complicated than plain text files. You can parse them as @Psycho_Coder did, but you will receive some more stuff than just the text you have written, e.g. formatting information, headers and so on. If the words you like to investigate are unlikely to occur in headers, it might not matter that they are there. Otherwise consider creating an Add-In for Word:
http://msdn.microsoft.com/en-us/library/...90%29.aspx
http://msdn.microsoft.com/en-us/library/...90%29.aspx

[Singularity_mybb_import13102]

I also want to mention that it would be wise to sort the array by placing the most used words first, and then the least used words. Since he is really wanting to only find the words that are used more often. It's tedious to self scroll through the array list to find the words used most, so making a hierarchy out of it would be helpful.

Something like this in Ruby:

Code:

#!/usr/bin/ruby puts "File: " print '> ' file = File.open(gets.chomp, 'rb') { |f| f.read } puts "Search for words used X or more times" print "X: " input = gets.chomp.to_i word_count = Hash.new words = file.split(' ') words.each do |w| if word_count.include?(w) word_count[w] += 1 else word_count[w] = 1 end end word_count = Hash[word_count.sort_by{ |w, a| a }].to_a.reverse puts "WORD : TIMES USED" word_count.each do |word, amount| if amount >= input puts "#{word} : #{amount}" end end

Allowing the user to only display words used X or more times, and echoing them out in a higher to lower sorted order.

Here is a live example with some tweaked code to make it work on the online interpreter.
(I'm not sure why the sorting is failing on the online interpreter, but I assume it's some sort of issue with the older Ruby version it uses. It probably lacks the sort technique I used)
http://repl.it/Xjc

Edit --
Just seen the graph, so eh this isn't much useful besides the fact of being able to control which words get output by volume.

[Psycho_Coder]

Good answer from @Psycho_Coder
Additionally you have to take into account that the format of office documents is a bit more complicated than plain text files. You can parse them as @Psycho_Coder did, but you will receive some more stuff than just the text you have written, e.g. formatting information, headers and so on. If the words you like to investigate are unlikely to occur in headers, it might not matter that they are there. Otherwise consider creating an Add-In for Word:
http://msdn.microsoft.com/en-us/library/...90%29.aspx
http://msdn.microsoft.com/en-us/library/...90%29.aspx

Actually using NLTK's RegexParser and FreqDist we can do it better by and faster but that would have been much harder for the OP and hence I resorted to this method but I didn't gave him the code for graphs since it would have been a lot for him hahaha

[daviesadeleye]

please @Singularity i think yours is more short and easy to understand. please want to know more about codes and all please. i'm a novice. thanks.

[ShawnReynolds]

Lol, two of the programming languages I have absolutely no experience/knowledge in, I planned on trying sooner or later though. Singularity, could you please tell me how to do that with a specific text file? I assume I have to enter the full path? I have never used Ruby before, but I have it installed.

EDIT: Also, what program would I use to edit Ruby code? I have tried Eclipse, but I do not know how to, as they do not have an option for Ruby.

[ShawnReynolds]

I also want to mention that it would be wise to sort the array by placing the most used words first, and then the least used words. Since he is really wanting to only find the words that are used more often. It's tedious to self scroll through the array list to find the words used most, so making a hierarchy out of it would be helpful.

Something like this in Ruby:

Code:

#!/usr/bin/ruby puts "File: " print '> ' file = File.open(gets.chomp, 'rb') { |f| f.read } puts "Search for words used X or more times" print "X: " input = gets.chomp.to_i word_count = Hash.new words = file.split(' ') words.each do |w| if word_count.include?(w) word_count[w] += 1 else word_count[w] = 1 end end word_count = Hash[word_count.sort_by{ |w, a| a }].to_a.reverse puts "WORD : TIMES USED" word_count.each do |word, amount| if amount >= input puts "#{word} : #{amount}" end end

Allowing the user to only display words used X or more times, and echoing them out in a higher to lower sorted order.

Here is a live example with some tweaked code to make it work on the online interpreter.
(I'm not sure why the sorting is failing on the online interpreter, but I assume it's some sort of issue with the older Ruby version it uses. It probably lacks the sort technique I used)
http://repl.it/Xjc

Edit --
Just seen the graph, so eh this isn't much useful besides the fact of being able to control which words get output by volume.

Would there be a way to get it organized by the number of words, from least to greatest, or vice versa?.

[ShawnReynolds]

I also want to mention that it would be wise to sort the array by placing the most used words first, and then the least used words. Since he is really wanting to only find the words that are used more often. It's tedious to self scroll through the array list to find the words used most, so making a hierarchy out of it would be helpful.

Something like this in Ruby:

Code:

#!/usr/bin/ruby puts "File: " print '> ' file = File.open(gets.chomp, 'rb') { |f| f.read } puts "Search for words used X or more times" print "X: " input = gets.chomp.to_i word_count = Hash.new words = file.split(' ') words.each do |w| if word_count.include?(w) word_count[w] += 1 else word_count[w] = 1 end end word_count = Hash[word_count.sort_by{ |w, a| a }].to_a.reverse puts "WORD : TIMES USED" word_count.each do |word, amount| if amount >= input puts "#{word} : #{amount}" end end

Allowing the user to only display words used X or more times, and echoing them out in a higher to lower sorted order.

Here is a live example with some tweaked code to make it work on the online interpreter.
(I'm not sure why the sorting is failing on the online interpreter, but I assume it's some sort of issue with the older Ruby version it uses. It probably lacks the sort technique I used)
http://repl.it/Xjc

Edit --
Just seen the graph, so eh this isn't much useful besides the fact of being able to control which words get output by volume.

Would there be a way to get it organized by the number of words, from least to greatest, or vice versa?.

[ShawnReynolds]

I also want to mention that it would be wise to sort the array by placing the most used words first, and then the least used words. Since he is really wanting to only find the words that are used more often. It's tedious to self scroll through the array list to find the words used most, so making a hierarchy out of it would be helpful.

Something like this in Ruby:

Code:

#!/usr/bin/ruby puts "File: " print '> ' file = File.open(gets.chomp, 'rb') { |f| f.read } puts "Search for words used X or more times" print "X: " input = gets.chomp.to_i word_count = Hash.new words = file.split(' ') words.each do |w| if word_count.include?(w) word_count[w] += 1 else word_count[w] = 1 end end word_count = Hash[word_count.sort_by{ |w, a| a }].to_a.reverse puts "WORD : TIMES USED" word_count.each do |word, amount| if amount >= input puts "#{word} : #{amount}" end end

Allowing the user to only display words used X or more times, and echoing them out in a higher to lower sorted order.

Here is a live example with some tweaked code to make it work on the online interpreter.
(I'm not sure why the sorting is failing on the online interpreter, but I assume it's some sort of issue with the older Ruby version it uses. It probably lacks the sort technique I used)
http://repl.it/Xjc

Edit --
Just seen the graph, so eh this isn't much useful besides the fact of being able to control which words get output by volume.

Would there be a way to get it organized by the number of words, from least to greatest, or vice versa?.