Centre for Internet and Society

WikiConference India 2016

praskrishna — 2016-08-07T01:35:50Z

WikiConference India 2016 is an event to provide a common platform for all Wikimedians in India to meet and share their views, discuss challenges and exchange useful tips, best practices and other information. The Conference is open for participation of Wikimedians from all nations, and will be taking place on the 5th, 6th, and 7th of August 2016 at Chandigarh.

The Conference has a very distinct Indian flavor and deals primarily with issues relating to India on Wikipedia and its sister projects.

The main objective is to reduce the gap between different communities and get help from other community members on technical issues and other things like best practices in decision making and how we resolve the disputes in the community.

Guests

Katherine Maher, Executive Director, Wikimedia Foundation
Nataliia Tymkiv, Board Member, Wikimedia Foundation
Asaf Bartov, Senior Program Officer, Emerging Wikimedia Communities, Wikimedia Foundation
Runa Bhattacharjee, Manager, Language Engineering Team (International), Wikimedia Foundation
Dr. Surjit Patar, Punjabi poet and writer
Tighe Flanagan, Senior Manager, Wikipedia Education Program, Wikimedia Foundation
Sunil Abraham, Executive Director, The Centre for Internet and Society
Yohann Varun Thomas, President, Wikimedia India
María Kreuz, Communications and Outreach Coordinator, Wikimedia Foundation

Social Media Campaign

Facebook event page - https://www.facebook.com/events/146258892472025/ (More suited for conference participants only)
Facebook Page - https://www.facebook.com/WikiConferenceIndia2016
Facebook group - https://www.facebook.com/groups/WikiConferenceIndia2016/
Official Twitter Handler - https://twitter.com/WikiConIndia
IRC Channel - #wikiconferenceindia

More Info, click here

For more details visit https://cis-india.org/a2k/news/wikiconference-india-2016

Wiki Loves Mayabazaar

Pavan Santhosh — 2017-06-07T09:24:35Z

On the 60th anniversary of the movie Mayabazar, Telugu Wikimedians celebrated Wiki Loves Mayabazar, an event to commemorate the cult Telugu film Mayabazar. As part of the celebrations, an edit-a-thon of the same name was held at Ravindra Bharathi in Hyderabad. Interestingly, the Cultural Department of Telangana Government sponsored the entire event.

In the Telugu speaking regions, there is a well-known appreciation of the cinematic arts. Mayabazar, released in 1957 captured the imagination of fans like no other film had before. Telugu Wikipedians decided to pay tribute to the movie by improving articles and content related to it on Telugu Wikipedia and other Wikimedia projects.

The edit-a-thon was held on 30 April, 2017 at the monthly Wikimitra Vedika meetup of Telugu Wikipedians. A screening of the film took place followed by discussions on references, citations, film studies and articles related to the film. From 1 May 2017, the edit-a-thon took place online.

There were 15 participants of which only one member was female. Telugu Wikipedian, Kasyap hoped for more participation as this "is an interesting event."

However, the event was made popular by the wide ranging media coverage in print and electronic media.

Media pieces on the event:

1. ‘మాయాబజార్‌’కు వినూత్న షష్టిపూర్తి

(Eenadu Newspaper; 1 May, 2017)

2.‘మాయాబజార్’కు 60 ఏళ్లు.. వినూత్న షష్టిపూర్తి వేడుకకు సిద్ధమవుతున్న వికీపీడియన్లు! (Ap7am.com; 1 May 2017)Wiki Loves Mayabazaar

For more details visit https://cis-india.org/a2k/blogs/wiki-loves-mayabazaar

Why It's Essential To Grow Indian-Language Wikipedias

subha — 2016-05-28T06:52:53Z

On 15 January, Wikipedia, the free online encyclopaedia celebrated its 15th birthday, meeting this milestone with 36 million articles in more than 290 languages (the English-language Wikipedia alone has crossed the 5-million article mark). But here I want to address some major questions that we need to ask as Indians.

This was published by Huffington Post on January 25, 2016. Also mirrored on Global Voices on February 26, 2016. The post was translated into Greek by Maria Souli. It was translated into Spanish by Daniela Diaz and into Russian by GV Russian

First, what is the state of Indian-language Wikipedia projects? What does India have to take from and give to Wikipedia?

With the growth of free and open source software in India, people are equipped with more freedom than ever. Especially with the recent federal policy-level changes, the nation is enjoying better collaboration with people of different cultures speaking different languages.

According to UNESCO, 197 of the total of 1652 Indian languages are dying despite having a long literary and linguistic heritage.

However, there is a huge gap in the access to knowledge on the internet domain. Of a population of about 1.26 billion only about 15-18% people are connected online, largely from mobile devices. A tiny fraction of this population comprises the technical community. It would be useful to have a metric on the percentage of this community's contribution to grow the languages of this country and its cultural heritage.

Wikipedia as a family

Wikipedia is not just an encyclopaedia. It is also a "family" of several other Open Knowledge members. Wikipedia itself is available in over 290 languages, but it also has other multilingual sister projects such as Wikisource (an online library of many public domain and other important texts), Wikimedia Commons (the world's largest repository of media files and documents), Wikibooks (a free library of educational textbooks), Wikivoyage (a free and open travel guide) and Wiktionary (a database of various languages).

These projects don't just house millions of images, videos, documents and texts, but allow anyone to contribute their knowledge to this ever deepening pool of information. Four Indian languages made an early entry to the Wiki-world back in 2002 -- Assamese, Malayalam, Odia and Punjabi.

Language neutrality

According to UNESCO, 197 of the total of 1652 Indian languages are dying despite having a long literary and linguistic heritage. It's quite shocking. In a blog post on content localisation, social entrepreneur Rajesh Ranjan asks if free and open source software can help save these dying languages. In the context of Wikipedia, there are already 23 South Asian-language projects. Out of these 20 are languages listed in the 8th schedule of the Constitution of India. Many might not have noticed that the "en" in the URL of Wikipedia that denotes the language code of English could be altered with "or" for Odia Wikipedia or "pa" for Punjabi Wikipedia.

Most Wikipedia projects in Indian language projects are relatively small compared to their counterparts. But the Wikimedia communities are thriving.

There are a fairly large number of native speakers waiting out there to access knowledge in their own languages.

When only parts of government websites are available in Hindi, the Hindi Wikipedia has crossed 10 million articles already. The Tamil and Malayalam Wikipedia communities have played a central part in implementing Wikipedia basics learning in the state-run school syllabus. Needless to say that these communities have played a significant role in implementing several free and open source software by pushing for policy-level change. Many Indian languages are in the pipeline to become active Wikipedia projects under the scope of the Wikimedia Incubator.

Maithili Wikipedia and Goan Konkani Wikipedia are the two Indian-language Wikipedias that have gone live in recent years. The world has seen how digital activism has brought a new life to the Hebrew language. There are a fairly large number of native speakers waiting out there to access knowledge in their own languages. Wikipedia could be a great tool for digital activism with openness and sharing.

Addressing gender bias in Wikipedia: Implications for India

India tops South Asia in the gender inequality index in the entire South Asia. The female literacy rate is an alarmingly low 65.46% as compared to 82.14% for men. This disparity is evident in many other sectors as well as in politics.

Digital India aims at digital literacy and availability of digital resources/services in Indian languages. This is closely aligned with the Wikimedia movement's goal....

But gender bias is not just a problem in India. The global free and open source software (FOSS) community has always been worried about the low presence of women contributors -- in the range of 2-5% range. Wikimedia Foundation's former executive director admitted that Wikipedia, like many other collaborative and open projects, does not have a conducive environment for women. But the Wikimedia community and Wikimedia Foundation are both working on improving this state of affairs. Indian-language Wikipedia projects are directly impacted by this global drive, be it the Women's History Month edit-a-thon where Wikipedia content largely related to women are improved every year or the Lilavati's Daughters project where biographies of Indian women scientists were created and enriched in Wikipedia projects.

Complementing Digital India

With a population of over 354 million netizens India still has a long way to go in increasing Indian language content on the web. The Government of India's new campaign Digital India aims at digital literacy and availability of digital resources/services in Indian languages. This is closely aligned with the Wikimedia movement's goal to provide free access to the sum of all human knowledge. In addition to Wikipedia, many other open educational resources and free knowledge projects that are not already a part of the Digital India campaign signal the need for the federal-run campaign to be more collaborative and open. Community-government collaborations like the NROER project to make NCERT books under Creative Commons licenses and IT@School project in the state of Kerala to provide education using free and open tools have gained massive traction and helped more Indian language content come online.

For more details visit https://cis-india.org/a2k/blogs/huffington-post-subhashish-panigrahi-january-25-2016-why-its-essential-to-grow-indian-language-wikipedias

Why aren’t Indians using Wikipedia to hold the government to account?

praskrishna — 2016-02-14T11:07:49Z

Despite its popularity, the site's benefits are going unutilised.

Madhav Gadgil's post was published by Scroll.in on February 6, 2016. CIS work was quoted.

Thanks to modern science and technology, the treasury of human material as well as intellectual and cultural wealth is overflowing. Enormous quantities of information are exchanged today at lightning speed, and incredible numbers of people separated by great distances are in constant touch with one another. Two contrasts characterise this world: on the one hand, disparities are growing in material wealth, and on the other, there is growing equality in access to informational and cultural resources.

The inequities in material wealth has accelerated the rate of degradation of the natural world, but at the same time progressive laws flowing from equality in intellectual wealth are helping people combat the degradation. This is one reason why, as much as ever, a well-informed citizenry is the lifeblood of social progress. Ensuring that citizens have ready access to reliable information is the prime responsibility of all of us, including obviously of our governments.

Wayward rulers

Regrettably, the government machinery is failing to discharge its responsibility.

Consider, for instance, Maharashtra’s irrigation scam, in which thousands of crores were siphoned off or wasted on dud irrigation projects. The statistics provided at various times by the state’s agriculture and irrigation departments are inconsistent. It is probable that none of them reflect the ground reality. Most rivers in Maharashtra are polluted well beyond legally permissible levels, yet the Maharashtra Pollution Control Board hardly acknowledges this sorry state of affairs. Such pollution often results in mass deaths of fish, but neither the fisheries department nor the Pollution Control Board maintains reliable records.

Or consider these two examples. After the people of Kerala succeeded in moving the government machinery, a committee of the legislature reported that 90% of the stone crushers in the state were operating without permission from local panchayats or without registering with district collectors. Another time, when the Central government-appointed Western Ghats Ecology Expert Panel revealed similar irregularities with solid evidence, the Centre first suppressed its report and then, pushed by a Delhi High Court order, made only an English version available. To top it all, the Maharashtra government uploaded on its website a Marathi summary full of distortions.

Clearly then, with the government machinery failing, people must work on their own to bring to light the true state of affairs. Fortunately, our media provides a good deal of reliable information on issues of public interest. For instance, it was newspaper reports that forced the Goa Forest Department to accept the presence of tigers in the state. It is again the media that often records large-scale fish deaths in our rivers.

Such information gets recorded on social media too, but this remains scattered, barring systematic efforts like as the one launched by the Hyderabad-based “Save Our Urban Lakes” coalition. Besides, much of the material on social media like Facebook is often self-centred and prejudiced, making it difficult to ascertain the veracity. On the other hand, newspapers and TV channels are continually exposed to sceptical public scrutiny, ensuring that, by and large, they deliver reliable information.

On balance then, people at large can wean genuine, reliable information only by carefully collating it from newspapers and TV channels, official documents and scientific studies and systematically organising it through some responsible social media.

Starting a discussion

Wikipedia is just such a reliable social medium. It is an entirely voluntary, cooperative, web-based enterprise aimed at freely and readily delivering all the knowledge in the world to all the citizens of the world in their own languages. The platform started off in 2000 with a call to experts to contribute articles on the pattern of Encyclopaedia Britannica, but without any remuneration. When experts showed little interested, Wikipedia was thrown open to citizens in 2001, converting it into an anyone-can-edit enterprise. After all, experts too acquire much of their knowledge reading what others have written.

Wikipedia operates on the understanding that laypeople may make mistakes, but these can be eliminated by ensuring open scrutiny and giving full scope for additions, deletions and corrections. That this system has resulted in material of a quality on a par with expert-written encyclopaedias has been established by studies by respected scientific journals. Moreover, not being constrained by the page limits of a printed encyclopaedia, it has generated greater amount of material with a broader scope.

All this has been achieved due to the dedication of 50,000-odd voluntary editors improving existing and writing new articles. This community of editors follow a set of conventions arrived at over the years through consensus. It has been decided that Wikipedia will not include material based on original observations, but instead verifiable information compiled from published studies or reports. Wikipedia believes in a “neutral point of view” presenting the different perspectives, provided these are supported by good evidence. Besides reliability, Wikipedia articles aim for speed (Wiki means quick). For instance, the article on the December 2004 tsunami was composed in two days through contributions of some 1,000 editors largely relying on newspaper and TV reports.

Every Wikipedia article is accompanied by a “discussion” page, on which a variety of issues can be explored without the strict constraints of neutrality and verifiability. This is in addition to the “discussion” page accompanying the “User” page that automatically gets assigned to anyone who registers on the website as a user. On all these debating platforms the site imposes only one major discipline – that they will not be used for self-promotion or abusing others.

Because of these noteworthy conventions, the information on Wikipedia has acquired a special significance. For instance, in Europe and the United States, it has served to subject the performance of political leaders to careful scrutiny. Biographical articles on leaders often include documentation of the promises made before election and the extent to which these were fulfilled. In the past, whenever agents of these leaders tried to delete unfavourable content, they were caught out quickly because Wikipedia preserves all versions of any article, including a record of the IP address of the computer employed to make changes.

The grassroots

Since Wikipedia is unconstrained by governmental control and cannot be subjected to commercial pressures because of its donation-based ad-free model, it is an outstanding medium to document what is happening on the ground. This information can be accumulated through incremental, asynchronous micro-contributions. In India, it presents an excellent instrument for common citizens to document their experiences and issues of concern on the English and the 21 Indian language editions.

The articles could deal with specific geographical localities such as cities (e.g. Pune), wards in a city (e.g. Kothrud in Pune), villages (e.g. Warkhand in Pedne taluka of Goa), talukas (e.g. Dodoamarg in Maharashtra), districts (e.g. Kolhapur or North Goa), rivers (e.g. Panchaganga, Mula-Mutha, Zuari). All we need is some official information source to initiate such articles. The 2011 Census of India is one such excellent database. Every census locality in this database is assigned a unique Census Location Code.

To explain with an example: each of the many villages named Loni, Wadgaon or Mendha in Maharashtra has a different Census Location Code. Similarly, there is a district and a city in Madhya Pradesh as also a town and a taluka in Karnataka, all sharing the name Sagar. Again, these are assigned four different Census Location Codes. This facility permits us to refer unambiguously to any geographical locality at various spatial scales such as district, taluka or city or village. In addition, on their Wikipedia entries, one could readily add the latitude, longitude and altitude off Google Earth.

As it happens, there exists a code – developed by Prashant Pawar – to automatically generate base articles on census localities. Three such Marathi articles, on villages Haladi (Karavir), Rukadi (Hatkangale) and Parite in the Panchaganga basin of Kolhapur district, have been uploaded on the Marathi Wikipedia.

No less than 40,000 such articles were automatically uploaded on the English Wikipedia around 2003-’04 and were then quickly developed further by other interested citizens. However, that was not the norm. While Bollywood celebrates Wikipedia with Shah Rukh Khan singing Mere bareme Wikipediape padh lo, Indians participate little in editing or creating new Wikipedia articles. For instance, an article on the Pune Bus Rapid Transit System on the English Wikipedia is merely based on an official pamphlet. It ignores the vigorous discussion on the subject, including the many news reports in the past several years. The discussion page accompanying the article is almost blank. Surely, the more aware citizens of Pune could put the powerful medium to good use to provide a more detailed and balanced account of their city’s Rapid Transit System.

Bonding across languages

We could, of course, follow the American pattern of automatically generating articles on all Indian localities covered in the 2011 Census. But Wikipedia is not just an encyclopaedia – it is a community, and in the absence of awareness about the enterprise, this approach might not be fruitful. The communal effort was visible when the residents of Haladi in Maharashtra initiated a base article on their locality.

Besides creating base articles, interested citizens can upload photographs, audio and video clips on Wikimedia Commons under a Creative Commons license, permitting anybody to freely use or modify the material after giving due credit to the original creator. Aside from this, citizens can also augment information on issues of their concern through Right to Information queries or enquiries from forums like zilla parishads, municipalities, state legislatures or the Parliament. The Centre for Internet and Society has developed excellent resource material to support citizens taking up Wikipedia-related activities. A group of volunteers led by Subodh Kulkarni is also promoting this participation, as is Goa University.

Much could be accomplished if Indians become active participants on Wikipedia. People could use their articles and their discussion pages to draw the attention of journalists or scholars to their concerns. For instance, people in the command area of a dam could call attention to the fact that no canals have been constructed to bring water to them. A journalist could then investigate the issue and develop a news story, which in turn could provide a verifiable reference for a Wikipedia article. Such interaction could constitute an effective and transparent social audit. One can visualise an array of topics for a social audit, ranging from the status of wage payments in rural employment guarantee works, pending forest rights claims, encroachment of real estate on river beds, privatisation of public beaches, and availability of public toilets for women.

The newly emerging facility of Wikidata can strengthen this social audit. Wikidata permits integration of data not only from English but from multiple languages, such as Hindi, Marathi, Malayalam and Kannada. For instance, sacred groves – forest fragments that are communally protected – constitute a traditional conservation practice not only in India, but also in Bhutan, Myanmar and even Nigeria. This tradition is still relevant – indeed, new sacred groves have recently been constituted in villages granted Community Forest Rights such as Pachgaon in Chandrapur district of Maharashtra.

Using Wikidata and keywords such as Devari (Marathi), Devpan (Konkani), Nagarbana or Devarakadu (Kannada), Sarpakavu (Malayalam), Oran (Hindi), one can quickly compile quantitative information on this practice, helping bring together people from across the country. Similarly, using keywords in different languages for a phenomenon such as mass fish mortalities, one may compile systematic information on this phenomenon that Pollution Control Boards deliberately ignore.

Of course, the objective of the Wikipedia enterprise is to compile objective, verifiable information from a neutral point of view and the Wikipedia community will not be involved in any activism. Nevertheless, such an exercise of putting together information could serve a useful function of organising a social audit. This could help, say, scattered members of fishing communities that are adversely affected by pollution-related fish mortalities to organise themselves.

Democratic approach

This is a golden age for those fascinated by knowledge. And Wikipedia is a triumphant manifestation of the age, a progressive enterprise of good-faith collaboration with the noble objective of making all knowledge available to people all over the world. The English Wikipedia has taken giant strides towards such a goal. The key to this success of science has been the rejection of all authority other than empirical facts and logical inferences, and its aim is to engage all those interested in knowledge regardless of their social, economic or educational background. It is this democratic approach that has facilitated the rapid accumulation of knowledge. Yet there are continual attempts by so-called experts to monopolise knowledge.

It is the duty of true lovers of knowledge to resist such attempts. Knowledge has a vast canvas. Our environment, our social settings are legitimate subject matters of knowledge and every citizen can be involved in nurturing it. Wikipedia is an important step in the direction of bringing on board all citizens in the pursuit of knowledge. The ability of the Wikidata facility to bring together knowledge scattered in multiple Indian languages is one manifestation of this progressive development. All of us Indians should join hands in developing a reliable understanding of the nature around us and of our society, polity and economy. This enterprise of taking Wikipedia to the grassroots would be a worthy contribution to the cause of nation building.

For more details visit https://cis-india.org/a2k/news/scroll.in-february-6-2016-madhav-gadgil-why-arent-indians-using-wikipedia-to-hold-the-government-to-account

What Indian Language Wikipedias can do for Greater Open Access in India

subha — 2016-10-22T04:12:40Z

The number of internet users in India was expected to reach 460 million by 2015, as the growth in the previous year was 49 percent. The total number of users for Hindi content alone reached about 60 million last year.

This was published by Your Story on October 20, 2016.

State of Indian languages on the internet

Based on a study, Internet activist Anivar Aravind mentioned that in 2014, although 89 percent of Indian population used mobile phones, only 10 percent of the population used smartphones (contributing to 13 percent of total mobile users). This means we can safely assume that a large section of online activity in India is through mobile devices ‑ thanks to the declining data charges because of high competition. That said the mobile internet connectivity in rural India is growing at a fast pace and vernacular content plays an important role in this great journey. With over 90 percent of the users being comfortable in their own native languages, websites that are producing content in Indian languages are going to drive this bandwagon.

Why open access is important for Indian languages?

Open access, in a nutshell, would mean research outputs and other educational resources that are free from restriction of access and use. The former includes resources like journals that are not paywalled, and the latter is freedom from copyright restriction. Open access as a movement encourages license migration ‑ a process of migrating from several copyrighted license terms to Creative Commons licenses and several other licenses that provide freedom to use, share and remix. In a country like India where there are only a handful of research journals available in vernacular languages, the need for open content becomes much more important. The more the restricted content, the less will be the access to knowledge. Creating more vernacular content with open licenses is like digging a well in a dessert.

Indian language Wikipedias as open access journals

It’s been almost a decade since most largely spoken Indian languages started having a Wikipedia project of their own. Presently, there are 23 Indian language Wikipedias, including newest entrants like Konkani and Tulu. That said, these projects are growing with more and more encyclopedic content written with a neutral point of view, which any internet user will find useful. Wikipedia is considered as the people’s encyclopedia and hence can have quite contrasting content ‑ some being poor because some volunteer editors lack expertise in high quality articles written by professionals. A great example of creating very high quality content in one particular subject area is Open Textbook of Medicine ‑ an offline encyclopedia consisting of Wikipedia articles related to medicine that was created by a group of dedicated volunteer medical professionals that happened to be Wikipedia editors. There is enormous potential to grow Wikipedia in multiple languages with high quality content.

How to grow open access in Indian languages using Wikipedia as a tool

The list of challenges to grow Wikipedia-like projects with volunteer effort could be endless. And one of the biggest challenges is bringing self-motivated people who are willing to contribute as volunteers. Also, there are many such people who are not aware that they can contribute to Wikipedia. The Wikipedia community has created an ecosystem by having several Wikimedia chapters and other affiliates that are run by both volunteers and paid staff ‑ the Wikimedia Foundation, a paid staff-run organisation that is responsible for fundraising, major technological and some community support. In India, Wikimedia India, Centre for Internet and Society’s Access to Knowledge program (CIS-A2K) and Punjabi Wikimedians are three such official affiliates that are working on catalysing the growth of the content and the communities. Where the affiliate Punjabi Wikimedians focuses on Punjabi language (in both Gurmukhi and Shahmukhi scripts), both Wikimedia India and CIS-A2K focus on all the Indian languages. CIS-A2K also specially focuses on five languages; Kannada, Konkani, Marathi, Odia and Telugu. Indian language Wikipedia projects can only grow if people can edit their own language Wikipedias.

With the Open Access Week—a week dedicated for promoting Open Access globally—around the corner with “Open in Action” as the theme of the year, there is no better time for anyone who can read and write in their native Indian language.

For more details visit https://cis-india.org/a2k/blogs/your-story-subhashish-panigrahi-october-20-2016-what-indian-language-wikipedias-can-do-for-greater-open-access-in-india

Van Bodh Workshop for content development on Forest Resources at Gadchiroli

Admin — 2018-11-06T01:36:39Z

CIS-A2K has collaborated with Tribal Research and Training Institute (TRTI) to facilitate development of Open knowledge resources on Community Forest Resource and content development in Wikimedia projects with community participation. These contents will become a part of "Van Bodh Knowledge repository".

Mumbai School of Economics and Public Policy, Bombay University has formulated and going to start a "Diploma course in Community Resource Management " with the support of TRTI, Pune from 2nd of oct 2018. This is a historic attempt to impart education of the level of a diploma to rural, especially tribal youth without any condition of academic qualification. The course was conducted at Mendha(Lekha) an hamlet in Dhanora taluk of Gadchiroli District. CIS-A2K has collaborated with TRTI to facilitate development of Open knowledge resources on Community Forest Resource and content development in Wikimedia projects with community participation.

For more details visit https://cis-india.org/a2k/events/van-bodh-workshop-for-content-development-on-forest-resources-at-gadchiroli

UTF-8, Indic and Stub Length Article in Wikipedia

pavanaja — 2016-10-20T02:26:29Z

One of the activities conducted as part of Wiki Conference India 2016 was the Punjab Editathon. It was about adding articles related to Punjab to Indian language Wikipedias and English Wikipedia. There was also an announcement made about some award for highest contribution.

See the original blog post at Dr. Pavanaja Blog

This lead to continued discussions in a closed chat group on how do we decide the winner. People thought it is very simple to announce the winner just based on highest number of bytes added. On first look, it looked very trivial and a simple case. I pointed out during the discussions about the encoding used in Wikipedia is UTF-8 and it uses different number of bytes for English and Indian languages. Before giving more details I would like to draw your attention to a simple experiment.

I typed Kannada letter ಅ (a) in my Sandbox in Kannada Wikipedia and saved it. Then I checked the RecentChanges page in Kannada Wikipedia. That showed that I have added 3 bytes to my Sandbox page. But I had added just one Kannada character. I did the same experiment in English Wikipedia. I just added one letter, the English letter “A” to my Sandbox in English Wikipedia and checked the number of bytes added. It showed just one byte.

What is going on? Here is the explanation. There are different ways Unicode text can be stored. UTF-8, UTF-16 and UTF-32 are the prominent ways. UTF-16 uses 2 bytes for all characters. UTF-32 uses 4 bytes. UTF-8 is a special kind of encoding. It uses series of single bytes to represent Unicode data. The first character, called Byte Order Mark (BOM) indicates what encoding is being used. Unicode website has more details on these. UTF-8 was mainly used for web as the networking devices used on the initial days of Unicode could handle only 8 bits (1 byte) of data. In other words, UTF-8 was used for backward compatibility with ASCII, the original 8-bit encoding used prior to the advent of Unicode. Even today the default encoding used by HTML is UTF-8.

Does these answer our original question? Not yet. I said UTF-8 uses series of single bytes. It uses 1 byte for English, 2 bytes for European languages and 3 bytes for Indian languages. That is the reason why we saw 3 bytes for one Kannada character.

This pops up another interesting question regarding the definition of a stub article in Wikipedia. As per Wikipedia, an article which has less than 2048 bytes is considered as a stub article. Go to any language Wikipedia’s search page and type Special:ShortPages to get the list of all articles which are having less than 2048 bytes. If we convert this into number of characters it turns out to be 2048 for English but about 682 for Indic. That means the length of a stub article will be different for English and Indian language Wikipedias. Should we have a different yardstick for the definition of a stub article for Indian language Wikipedias then? I think yes.

For more details visit https://cis-india.org/a2k/blogs/utf-8-indic-and-stub-length-article-in-wikipedia

Using the Wikimedia sphere for the revitalization of small and underrepresented languages in India

subodh — 2024-02-10T04:35:45Z

This report explores opportunities within the Wikimedia movement and projects to help revitalise small and underrepresented languages in India and provide recommendations to CIS’s Access to Knowledge team in furthering this effort. The report is mainly based on a roundtable conversation on Digital Access in Bhubaneswar with a diverse range of backgrounds and professions, including independent researchers, representatives from non-profit organizations, retired government officials, Wikimedia contributors (both Odia and Santali), ecological activists, directors of research institutes, consultants, and journalists. This was organized by the Access to Knowledge team of CIS in collaboration with Vasundhara, Bhubaneswar.

This strategic note discusses a broad program idea of offering barrier-free open access to resources in various underrepresented languages in India.

Languages spoken in the Republic of India belong to several language families, the major ones being the Indo-Aryan languages spoken by 78.05% of Indians and the Dravidian languages spoken by 19.64% of Indians. Languages spoken by the remaining 2.31% of the population belong to the Austroasiatic, Sino–Tibetan, Tai–Kadai, and a few other minor language families and isolates. According to the People's Linguistic Survey of India, India has the second highest number of languages (780), after Papua New Guinea (840). Ethnologue lists a lower number of 456.

The UNESCO endangerment classification is as follows:

Vulnerable: most children speak the language, but it may be restricted to certain domains (e.g., home)
Definitely endangered: children no longer learn the language as a 'mother tongue' in the home
Severely endangered: language is spoken by grandparents and older generations; while the parent generation may understand it, they do not speak it to children or among themselves
Critically endangered: the youngest speakers are grandparents and older, and they speak the language partially and infrequently
Extinct: there are no speakers left

North-East India is home to more than 200 languages, out of which 82 are listed as Vulnerable, 63 as Definitely Endangered, 6 as Severely Endangered, 46 as Critically Endangered and 6 as Extinct (The Guardian Dataset). Arunachal Pradesh is the state with the highest number of languages, with as many as 66 languages spoken there, while West Bengal has the highest number of scripts, nine, and around 38 languages.

The state of Odisha has 62 Scheduled Tribes who speak as many as 74 dialects. Their ethos, ideology, worldview, value orientations and cultural heritage are rich and varied. Odisha has the unique distinction of having 93 different Scheduled Caste communities spread over 30 districts and 314 blocks of the state having different dialects. Apart from the languages of the North-East and the state of Odisha, there are several other languages all over India that deserve better representation on the Internet. While a handful of these languages enjoy status and visibility as official languages of the states and thereby hold some currency as widely spoken languages in their linguistic territories, there are many more languages that do not have speakers counting beyond a few hundred. Examples include the Bellari language (Spoken in Karnataka by 1000 speakers), the Toda language (Spoken in Tamil Nadu by 1600 speakers) and the Naiki language (Spoken in Maharashtra by 1500 speakers). What these languages do share in common with the languages of the North-East mentioned earlier is that they all lack free and open source knowledge and data.

Some of these languages are the official languages of the states and are widely spoken in this region. On the other hand, some of the languages have a few hundred native speakers. However, irrespective of the size of the native population or official status of the language, they all lack free and open source knowledge & data.

These languages show a range of marked cross-linguistic features which pose several interesting questions to Linguistic theories and speech processing research. Moreover, the close geographical proximity of these languages makes them vulnerable to changes in multiple linguistic levels, making these languages an excellent resource to study language change. Despite this, these languages severely lack digital preservation. One of the major reasons that contribute to the lack of resources is the difficulty in human access to some of the areas in these regions. Moreover, with English and Hindi being used as a lingua franca in these regions, the actual number of speakers proficient in their native language is much fewer than the number shown in the census reports. This makes it more important than ever to initiate a preservation process which does not primarily depend on fieldwork while also increasing the presence of the language in the digital sphere.

As language technologies advance and more sophisticated tools are built using Artificial Intelligence, the divide between low resource languages and others is likely to get even larger as a common prerequisite of these advanced systems is the existence of a large amount of digital data. Low resource languages are at a risk of being left behind.

Research on these languages by researchers are mostly conducted by collecting data personally, which causes a huge hindrance to the research process, as most of it remains as a private collection or published in closed journals. Moreover, data collection through fieldwork is particularly challenging in this region due to the restricted access to most of the disturbed areas.

The goal of this program is to facilitate the study of these languages by making existing resources discoverable and building open-source structured datasets and tools using the Wikimedia sphere to enrich the language research landscape of small and underrepresented Indian languages.

Role of CIS-A2K

To design and commission relevant research studies in collaboration with language communities to define the premises of the program. The plan is to work with languages which are being written in single or multiple scripts in the pilot phase.
To develop strategies regarding the integration of language datasets with Wikimedia projects
Skill building of volunteers and community leaders in Wikimedia projects
Structure of local knowledge to be compiled for contribution
To identify the specific Wiki projects such as Wikipedia, Wikimedia Commons, Wikidata, Lingua Libre etc to build the archives of these languages
Designing outreach and knowledge dissemination processes
To develop partnerships with other academic, social, cultural and research institutions in the language sector for the sustainability of the project
Material support - Sound recorders, microphones, hard discs, laptop, scanner, internet hardware
Financial support - Remuneration of intern/fellow, internet data recharge

Specific objectives

Empowering the communities by enhancing digital literacy and connecting them with the world of knowledge and people outside.
Revitalizing/enriching the languages by increasing their use, coverage and depth using technological interventions.
Creating an ecosystem for developing language learning resources and tools; particularly, in the context of the New Education Policy.
Enabling scholars and researchers to overcome the challenge of finding appropriate data and expanding the knowledge on these languages.
By using the Wikimedia sphere, the infrastructural and technological support is secured, so that these languages are able to function in the digital world.

It is important to realise that these objectives can introduce new dynamics into other spheres of activity, such as education and the development of language.

Methodology

Our target languages broadly belong to two sets:

Languages which are primarily spoken in various states of India and have some or no digital presence on the internet.
Endangered languages which have extremely limited or no digital presence.

Survey of ongoing work

Several individuals and institutions are working on languages across the globe. There are significant initiatives in India also to revitalise the small languages in the digital sphere. Some of these are listed in the reference section at the end. An exhaustive survey of all such efforts will be done to map the present status as well as a listing of stakeholders. The target languages for A2K’s future work and the potential collaborators will also be identified through these exercises.

Digital Dictionary Making

A dictionary is a vital resource for any language learning. The idea of collaborative dictionaries using platforms like Wiktionary or Wikidata Lexemes eliminates the need for expert lexicographers and terminologists and rather follows the method in which the users enter data as new entries, definitions, and so on, and the same is reviewed by editors, once published. An offline e-dictionary application using this dataset could be developed to overcome the problem of sparse internet connectivity where the user is only expected to download & install the application once and use the dictionary offline at any moment.

Data Acquisition Strategies

Leveraging Crowdsourcing using LinguaLibre for the creation of Speech CorporaGiven the scarcity of text and speech corpora for these low-resource languages, the main potential source for dataset creation is by crowdsourcing.
Using Optical Character Recognition techniques -

The digitisation of texts in the public domain would be done and made available freely by uploading them on Wikimedia projects. The digital copy will be made machine-readable using Optical Character Recognition (OCR).

Processing the acquired data

Preprocess
Processing Speech Corpora
Processing Bilingual Parallel text Corpora

Housing datasets

Wiki Commons for media files
Wikidata for Lexemes
Wikisource for texts

Capacity Building workshops

Promoting the language among the young speakers of the community, since they are the future of the language and if it survives, it will belong to them.

Help language speakers possess up-to-date digital competencies and feel confident about them to actively participate in the digital world and increase content in their own native language.

Promoting contributions on platforms like Storyweaver, Pratham Books, Eklavya etc.

Promote the upskilling of native speakers and other disseminators

Facilitate knowledge exchange through participatory mechanisms both virtually and face-to-face.

The potential communities would be introduced to Incubator for building new Wikimedia projects

Educational development

Applying Open access philosophy to advance language pedagogy.

Develop language learning resources and tools, particularly, in the context of the New Education Policy.

References

Wikipedia articles
SCSTRTI, Odisha - https://www.scstrti.in/index.php/resources/mle-initiative/bilingual-dictionaries
Most populous languages of Odisha - https://commons.wikimedia.org/wiki/File:Languages_of_Odisha.svg
People’s Linguistic Survey of India - https://www.peopleslinguisticsurvey.org/
The state and fate of linguistic diversity and inclusion in the NLP world - https://aclanthology.org/2020.acl-main.560/
Bhasha India - https://www.microsoft.com/en-in/bhashaindia
Omniglot - https://www.omniglot.com/index.htm
Bharatavani - https://bharatavani.in/
Storyweaver - https://storyweaver.org.in/
Dimasa Thairili - https://www.dimasathairili.com/
SIL International - https://www.sil.org/
Ethnologue - https://www.ethnologue.com/
Global Recordings Network - https://globalrecordings.net/en/
Glottolog - https://glottolog.org/
Endangered Languages Project - https://endangeredlanguages.com/

This is a report by Subodh Kulkarni with editorial oversight and support by Tanveer Hasan and Soni Wadhwa. Click to download the PDF here.

For more details visit https://cis-india.org/a2k/blogs/using-wikimedia-sphere-for-revitalization-of-small-and-underrepresented-languages-in-india

Using Kannada in technology made easier with smartphones

praskrishna — 2016-11-01T05:19:17Z

With the IT revolution, many believed that the younger generation would prefer to type and communicate in English than Kannada.

Dr. U.B. Pavanaja was interviewed by the New Indian Express. The article was published on November 1, 2016.

But U B Pavanaja, a member of Kannada Software Committee and a Kannada Wikipedia administrator, believes with latest technology, the use of Kannada has only been increasing. As the state celebrates Karnataka Rajyotsava today, Ashwini M Sripad spoke to Pavanaja on adapting Kannada language to the latest technology.

Where does Kannada stand when it comes to adopting technology?

Quite good. But not the best. Most tools needed to use Kannada in technology are available now. They are almost perfect.

Has there been any change in the use of Kannada in computer/mobile by youngsters in the last decade?

Yes. Due to the availability of Kannada input methods, and advent of smartphones, many youngsters are now using Kannada on their computers and smartphones. More people are typing in the Kannada script itself.

What should the state government do to popularise Kannada in technology?

A lot needs to be done. There was a committee to look into the standardisation and proper implementation of Kannada in technology. The committee submitted its report. The government implemented some parts of the report. After that nothing has been done. Now the committee does not exist. Standardisation is a continuous process. There must be a permanent committee to look into this. For example, domain names (website names) are available now in Hindi, Tamil, Bengali, etc., but not in Kannada. This is due to the fact that no one represents Kannada in meetings of W3C India, an international community to develop web standards.

How is the response to Kannada Wikipedia?

A lot of awareness has been created among people about the existence of Kannada Wikipedia in the last three years. But more needs to be done.

What can be done to improve it further?

At present, the articles are written by enthusiastic Kannadigas who are not really writers. They are doing this out of passion for the language. But well-known Kannada writers don’t edit Kannada Wikipedia. Kannada has a good number science writers, but they are not editing Kannada Wikipedia, which is very badly needed at this time. Also, there is no comprehensive printed encyclopaedia in Kannada for science and technology. The last one came out 18 years ago. Therefore students in Kannada medium schools need a good Kannada encyclopaedia. This requirement can be met by Kannada Wikipedia. But the number and quality of articles is far from sufficient. Writing for Kannada Wikipedia could be made compulsory for degree and post-graduate students to bring in some well-researched articles. Such programmes already do exist in some colleges in the state but we need more.

For more details visit https://cis-india.org/a2k/news/new-indian-express-november-1-2016-using-kannada-in-technology-made-easier-with-smartphones

Unable to read Odia on your android device? Don’t fret!

praskrishna — 2015-12-15T08:04:39Z

If you get only boxes in place of Odia fonts in your Android device then it does not support the language. So you need to install Odia font in your smart phone; one way is to root it, but it’s not without cons.

The article by Ruby Nanda was published in Odisha Sun Times on September 28, 2015. Subhashish Panigrahi was quoted.

Rooting means breaking and getting full rights into the entire operating system of your Android. If done right it can turn you into a super user and open a wealth of opportunities with your handheld device. But, rooting is a complex process and definitely not for a newbie, as rooting leads to loss of warranty, security issues and a wrong move can turn it into a paperweight.

“Rooting is not advisable as it is bit complicated and turns your phone warranty void”, says Subhashish Panigrahi, Programme Officer at the Centre for Internet and Society, an NGO. By far the easiest way to read Odia is by installing Firefox Browser for your android mobile, he added.

Nihar Kumar Dalai, IT professional, has found an easy hack and with Panigrahi, he has designed a free licensed tutorial by which one can easily read Odia language in their smart phones.

“Odia fonts are supported only in the latest android 5.1.1 update, but people using android devices with older version may not have Odia fonts and can see only the boxes. We see many people seeking help to resolve this problem on Twitter and Facebook. With missing Odia fonts, people may end up writing Odia in Roman script, said Dalai.

“There has been very positive response from people who have tried this method. I’m happy to play a very small part for this cause, the IT professional added.

So if you are unable to read or write Odia in your android handheld then no sweat, just try out these simple steps and enjoy the fun of reading and writing Odia in your mobile.

Install Mozilla Firefox browser for Android on your phone from Google Play.
Launch Firefox and go to the Oriya fonts package Add-Ons page and select “Add to Firefox”
Click on Install
Eureka! Now Odia fonts appear on your android device instead of unrecognizable boxes.

Click here to watch the tutorial:

https://or.wikipedia.org/s/ucf

Once you’re able to read and write Odia, you can use any online Odia transliteration service e.g. TypeOdia (on Firefox browser), iBUS on Linux, Microsoft’s Indic language Input Tool, Google Input Tool.

P.S: This method only works on Firefox Browser for Android and not on any other Apps. Android jellybean 4.3 version also supports Odia but there might be issues which are fixed by 5.1.1.

For more details visit https://cis-india.org/openness/news/odisha-sun-times-september-28-2015-ruby-nanda-unable-to-read-odia-on-your-android-device

Typography Day 2016

praskrishna — 2016-04-24T15:16:04Z

Typography Day was organized for the 9th time at Srishti Institute of Art, Design and Technology, Bangalore in collaboration with the Industrial Design Centre (IDC), Indian Institute of Technology Bombay (IIT Bombay) with support from India Design Association (InDeAs) and Aksharaya.

Subhashish Panigrahi was a speaker at the event. He along with Pooja Saxena made a presentation on Bringing Ol Chiki to the Digital World.

Typoday 2016: Presentation by Pooja Saxena and Subhashish Panigrahi from Subhashish Panigrahi

For more details visit https://cis-india.org/a2k/news/typography-day-2016

Tulu Wikipedia Tutorial

praskrishna — 2015-12-15T07:50:52Z

Dr. U.B. Pavanaja trained the people involved in the creation of the videos.

Tutorial video on starting with Tulu Wikipedia which is in incubation:

Tutorial video explaining how to start with Tulu Wikipedia which is in incubator:

Tutorial video explaining how to add new article to Tulu Wikipedia:

Tutorial video explaining how to type in Tulu Wikipedia:

Tutorial video explaining how to format articles in Tulu Wikipedia:

The people behind these videos:

Prof. Vishwanatha Badikana for Script
Lasya Shetty for Voice
Abhishek Shetty, Saarang Community radio at St Aloysius College Mangaluru for Audio Recording
Soundarya Shetty for Mixing and Editing
Dr. U.B. Pavanaja for Conception, Direction, Mixing and Editing

For more details visit https://cis-india.org/openness/news/tulu-wikipedia-tutorial

Tulu Wikipedia Goes 'Live' after 8 Years on Incubator

praskrishna — 2016-09-22T01:33:29Z

Eight years after being created in the Wikimedia Incubator, the Tulu-language Wikipedia is now live as the 23rd Indic language.

The Tulu Wikipedia page is available here. The project has a total of 1285 articles contributed by 198 editors.

Other news in brief:

Ongoing India At Rio Olympics 2016 Edit-a-thon promises to plant one tree for every 20 new articles created.
Wiki Loves Monuments returns to India after three years.
WikiConference India 2016, the largest Wikimedia community gathering of the year in South Asia comes to an end.
Ashutosh Sarangi , the youngest Wikimedian from the oldest Indian-language Wikipedia community.

Tulu Wikipedia Goes 'Live'

praskrishna — 2016-08-07T01:41:56Z

Tulu Wikipedia became live on August 5, 2016. CIS-A2K took making of Tulu Wikipedia live as one of its activity in 2014. The efforts bore fruit and Tulu Wikipedia is live now.

CIS-A2K team is thankful to all the volunteers who contributed to Tulu Wikipedia and helping it see the light of the day. We would specifically thank Dr. Vishwanatha Badikana and Bharathesha Alasandemajalu who have contributed with the most edit counts and at present are participating in the WIkiconference India.

Tulu Wikipedia page here

For more details visit https://cis-india.org/a2k/news/tulu-wikipedia-goes-live

Tulu Wikipedia Editathon to Improve Quality of Articles in Tulu Wikipedia

praskrishna — 2016-05-07T15:43:42Z

The Centre for Internet & Society's Access to Knowledge team (CIS-A2K) organized a Wikipedia editathon for improving Tulu Wikipedia. Dr. U.B. Pavanaja conducted the sessions.

Dr. Kishore Kumar Rai, Principal of Shri Ramakrishna PU College, who himself is an active Tulu and Kannada Wikipedian provided the lab for this activity. Any Wikipedian (Tulu/Kannada) can walk-in and make use of the lab to edit Wikipedia. He has also procured more than 100 Tulu books from Tulu Sahitya Academy which will be kept there for reference.

Agenda

Improve the quality of articles in Tulu Wikipedia
Increase the length of short articles
Add inter-wiki links
Add references
Add images
Add categories
Improve language

The event will continue in June. More details can be accessed here.

For more details visit https://cis-india.org/a2k/events/tulu-wikipedia-editathon-to-improve-quality-of-articles-in-tulu-wikipedia