Centre for Internet and Society

Vachana Sanchaya: Bringing Access to 11th century Kannada Literature

subha — 2014-04-08T01:48:18Z

The blog post throws light on providing access to Vachana Sanchaya, a eleventh century Kannada literature.

The article was published in Open Access Week on April 3, 2014.

During early 11th century a form of spiritual Kannada language poetry in the Indian state of Karnataka called Vachana sahitya became quite popular. It started flourishing in the 12th century by a religious movement called Lingayatha movement. More than 259 Vachana writers, called Vachanakaru, compiled over 11,000 vachanas (verses). 21,000 of these verses in 15 volumes were published by the Government of Karnataka into an online portal called Samagra Vachana Samputa. Two Wikimedians along with two linguists brought these verses on a standalone project called Vachana Sanchaya. Kannada Wikimedians, Pavithra Hanchagaiah and Omshivaprakash HI along with Kannada linguist O. L. Nagabhushana Swamy converted the font to Unicode to make the verses searchable on this project. The entire collection is now ready to enrich the Kannada WikiSource.

The text in Samagra Vachana Samputa were typed using fonts of ISCII, an Indian character encoding standard. Indic characters generally replace Latin ones inside the font that makes them completely useless when someone does not have the particular font installed in the computer. This is a typical problem with non-Latin fonts, especially Indic typefaces. In case of this particular publication, there were more than 5 ISCII standards which made searching and reusing content completely impossible. Hanchagaiah and Omshivaprakash started writing scripts to make the Vachanas searchable through an index. This demanded a user friendly platform for the linguistic researchers, students, and the public interested in accessing this literature.

Omshivaprakash worked on designing the architecture for this platform using open source software tools. Hanchagaiah was involved in providing critical hacks for digitization and valuable inputs through suggestions, feedback, and quality assurance.

At present, Vachana Sanchaya project has around 200,000 unique words that were derived from these verses. The public has been using the repository and accessing vachana from Facebook, Twitter, and Google+ profiles. There are thousands of people now who read a Vahana as part of their daily routine. Vachana Sanchaya is not only a gateway for reading the literature, but also a research platform for Kannada language and literature. It has options for researchers to help in reviewing content which in turn will help to add references from research papers.

All of the content is currently available to the public through the OpenData API, and once the reviewing the work is complete, it will be distributed in the public domain through WikiSource. This will open up the system for students, developers, researchers, and anyone interested in building linguistic tools for Kannada and other Indic languages. Users will be able to use our code to digitize any book available in the public domain. Early literature in any language is well-respected, so making it available via an open platform allows for reuse of the content for research, publication, and other documentation work.

Other similar projects could take help from this project and use any part of the processes.

Plans going foward:

To initiate Natural Language Processing (NLP) projects if more researches help to tag words and grow the glossary.
To continue work on subsequent, similar projects for Sarvagnana Vachanagalu and Dāsa Sanchaya (work has begun) and Vyāsa and Muddann (work to be started)
To extend this platform to other the contemporary literature works available in the public domain.

Authored by Pavithra Hanchagaiah, Omshivaprakash HI and Subhashish Panigrahi. Draws inspiration from another article published on Opensource.com under CC-BY-SA 4.0

For more details visit https://cis-india.org/openness/blog-old/openaccessweek-april-3-2014-subhashish-panigrahi-vachana-sanchaya

Vachana Sanchaya: 11th century Kannada literature to enrich Wikisource

subha — 2014-03-20T11:13:22Z

Kannada Wikipedian Omshivaprakash, Pavithra and I co-authored this article on digitizing Vachana Sahitya, a 11th century Kannada literature on WikiSource.

Pavithra Hanchagaiah and Omshivaprakash HI, Wikimedians from India are co-authors with Subhashish Panigrahi in this article. This was originally posted on Wikimedia blog and published by GlobalVoices on March 18, 2014.

In the poetry of Kannada (an Indic language), Vachana sahitya is a form of rhythmic writing that evolved in the 11th Century C.E. and flourished in the 12th century, as part of the “Lingayatha” movement. More than 259 Vachanakaras (Vachana writers) have compiled over 11,000 vachanas. 21,000 of these verses which were published in a 15 volume “Samagra Vachana Samputa” by the government of Karnataka have been digitized. Two Wikimedians along with a Kannada linguist and author O. L. Nagabhushana Swamy are involved in the Unicode conversions, corrections and writing preface for these verses. The entire work is now available as a standalone project called “Vachana Sanchaya” and ready to enrich Kannada Wikisource.

This project was started a year ago when Kannada Wikimedian Omshivaprakash was trying to help Professor O.L. Naghabhushana Swamy and Kannada author and publisher Vasudhendra access the vachana (verses) of Vachana Sanchaya. Swamy had trouble using publicly available content on Vachanas since the data was in ASCII standard and searching text was a huge problem. I (Pavithra Hanchagaiah) started to help gather information about vachanas and document it in Unicode by writing scripts for open source software. Further discussions were had to get thousands of vachanas in the form of a database, so that they could be easily searchable with an index. This demanded us to build a platform supporting all these activities, which would help the linguistic researchers, students and members of the general public who have an interest in reading and studying Vachana literature. With this idea, Omshivaprakash started designing the model, and his colleague Devaraju started building it. In the meantime I was running various scripts to fix errors in conversion of ASCII text to Unicode, confirming that the data was ready to consume by the modules developed for concordance. We spent weekends & holidays executing this project from home. With the constant feedback and guidance from Mr. Swamy and Vasudendra, we learned how concordance of text is used by researchers and what would make it easier for them to research on Vachana Sahitya. Omshivaprakash worked on the architecture of the platform, decided the infrastructure requirements – free and open source software technologies were used to keep the platform active while managing the entire project. I provided critical hacks for digitization and gave feedback through suggestions.

Working System Currently, the system has around 200,000 unique words in its repository. Vachana Sanchaya is meant for research rather than just a repository of text on the web. While you search the words on our system, you can see who has used the word in all Vachanas. To make the research more readable, we highlight the text searched in each Vachana that would be displayed. To repeat the search for a specific Vachanakara (poet) you just need to click on his name on the graph on the results page. We have used MediaWiki’s jquery-ime input tool architecture that helped us provide a feature to directly enter Kannada text in Unicode for searches. So just type, and get results!	Vachana Sanchaya Website Screenshot

Working System

Currently, the system has around 200,000 unique words in its repository. Vachana Sanchaya is meant for research rather than just a repository of text on the web. While you search the words on our system, you can see who has used the word in all Vachanas. To make the research more readable, we highlight the text searched in each Vachana that would be displayed. To repeat the search for a specific Vachanakara (poet) you just need to click on his name on the graph on the results page. We have used MediaWiki’s jquery-ime input tool architecture that helped us provide a feature to directly enter Kannada text in Unicode for searches. So just type, and get results!

Vachana Sanchaya Website Screenshot

Public Response

We are glad to see people accessing vachanas from our Facebook, Twitter and Google+ channels. There have been approximately 500,000 pageviews to our site in the first few months of our platform’s public launch. Interestingly, commonly searched Kannada words like “ಕರ್ಮ”(Karma en:Work/Deed) , “ಸತ್ಯ” (Sathya -en:Truthfulness ) and “ನದಿ” (River) have resulted in quick and easy results.

Plans for the future

ಆಂಗೀರಸ, ಪುಲಸ್ತ್ಯ, ಪುಲಹ, ಶಾಂತ,ದಕ್ಷ, ವಸಿಷ್ಠ, ವಾಮದೇವ, ನವಬ್ರಹ್ಮ, ಕೌಶಿಕ, ಶೌನಕ, ಸ್ವಯಂಭು, ಸ್ವಾರೋಚಿಷ, ಉತ್ತಮ, ತಾಮಸ, ರೈವತ, ಚಾಕ್ಷಷ, ವೈವಸ್ವತ, ಸೂರ್ಯಸಾವರ್ಣಿ, ಚಂದ್ರಸಾವರ್ಣಿ, ಬ್ರಹ್ಮಸಾವರ್ಣಿ, ಇಂದ್ರ ಸಾವರ್ಣಿ ಇವರು ಇಪ್ಪತ್ತು ಮಂದಿ ಪ್ರಪಂಚ ನಿರ್ಮಾಣ ಸಹಾಯ[ದ]ವರು. ಹತ್ತೊಂಬತ್ತು ಎಂದರೆ ಪುಣ್ಯನದಿಗಳು. ಅದು ಎಂತೆಂದಡೆ: ಗ್ರಂಥ

Our system is extensible with respect to adding new feature – we have a review desk for researchers to help us with the review of content. Later we will also be adding required references to Vachanas from various research works that have been done around this literature. The content is available to the public through OpenData API and will be distributed as public domain through Wikisource once the review work is complete. This will open up the system for students, developers, researchers and anyone interested in working around building linguistic tools for Kannada and other Indic languages. This system is meant to evolves around other works rather than having to change and re-invent the wheel for more such projects. Vachana Sahitya will further help us to initiate Natural Language Processing (NLP) projects if more researchers get together to tag the words, glossary etc in the coming days. We can also fulfill the need of various language tools like spelling and grammar checker for users through crowd-sourcing the development. The next projects under the “Kannada Sanchaya” are Sarvagnana Vachanagalu and Dāsa Sanchaya which are in the pipeline with initial phases of work underway. Our idea is to extend this platform from Vyasa to Muddanna and possibly the contemporary literature work available in the public domain.

For more details visit https://cis-india.org/openness/blog-old/vachana-sanchaya-11th-century-kannada-literature-to-enrich-wikisource

UTF-8, Indic and Stub Length Article in Wikipedia

pavanaja — 2016-10-20T02:26:29Z

One of the activities conducted as part of Wiki Conference India 2016 was the Punjab Editathon. It was about adding articles related to Punjab to Indian language Wikipedias and English Wikipedia. There was also an announcement made about some award for highest contribution.

See the original blog post at Dr. Pavanaja Blog

This lead to continued discussions in a closed chat group on how do we decide the winner. People thought it is very simple to announce the winner just based on highest number of bytes added. On first look, it looked very trivial and a simple case. I pointed out during the discussions about the encoding used in Wikipedia is UTF-8 and it uses different number of bytes for English and Indian languages. Before giving more details I would like to draw your attention to a simple experiment.

I typed Kannada letter ಅ (a) in my Sandbox in Kannada Wikipedia and saved it. Then I checked the RecentChanges page in Kannada Wikipedia. That showed that I have added 3 bytes to my Sandbox page. But I had added just one Kannada character. I did the same experiment in English Wikipedia. I just added one letter, the English letter “A” to my Sandbox in English Wikipedia and checked the number of bytes added. It showed just one byte.

What is going on? Here is the explanation. There are different ways Unicode text can be stored. UTF-8, UTF-16 and UTF-32 are the prominent ways. UTF-16 uses 2 bytes for all characters. UTF-32 uses 4 bytes. UTF-8 is a special kind of encoding. It uses series of single bytes to represent Unicode data. The first character, called Byte Order Mark (BOM) indicates what encoding is being used. Unicode website has more details on these. UTF-8 was mainly used for web as the networking devices used on the initial days of Unicode could handle only 8 bits (1 byte) of data. In other words, UTF-8 was used for backward compatibility with ASCII, the original 8-bit encoding used prior to the advent of Unicode. Even today the default encoding used by HTML is UTF-8.

Does these answer our original question? Not yet. I said UTF-8 uses series of single bytes. It uses 1 byte for English, 2 bytes for European languages and 3 bytes for Indian languages. That is the reason why we saw 3 bytes for one Kannada character.

This pops up another interesting question regarding the definition of a stub article in Wikipedia. As per Wikipedia, an article which has less than 2048 bytes is considered as a stub article. Go to any language Wikipedia’s search page and type Special:ShortPages to get the list of all articles which are having less than 2048 bytes. If we convert this into number of characters it turns out to be 2048 for English but about 682 for Indic. That means the length of a stub article will be different for English and Indian language Wikipedias. Should we have a different yardstick for the definition of a stub article for Indian language Wikipedias then? I think yes.

For more details visit https://cis-india.org/a2k/blogs/utf-8-indic-and-stub-length-article-in-wikipedia

USTR elaborates the Two Dozen Digital Rules of Club TPP

sinha — 2016-07-29T08:00:00Z

Members of the recently concluded Trans-Pacific Partnership (TPP) are now scrounging the world to include more countries in its fold. The Digital 2 Dozen(D2D) is a bite-sized document which packs the TPP into 24 key tenets. The D2D, aggressively championed by the US as the path forward for the global digital economy poses some critical questions for India: first, how will India position itself against US pressure in the larger scheme of US-India foreign relations, and how much is it willing to concede its policies in the name of trade; second, how will reduced barriers and establishment of a level field for Indian and foreign IT and internet companies alike, hurt Indian consumers and businesses? This week, the Deputy US Trade Representative Ambassador Robert Holleyman discussed the Digital 2 Dozen document with Ambassador Shyam Saran (Chairman, RIS). The exchange was moderated by Samir Saran (Observer Research Foundation). I attended the discussion and this post is a summary of the key points.

For a background on the data protection and privacy aspects of the Trans-Pacific Partnership agreement and Digital 2 Dozen principles, please read CIS' piece here.

Ambassador Robert Holleyman

Ambassador Holleyman opened with stating that trade agreements are created to build a foundation for national policies. He added that the D2D is not merely a tech D2D, rather it is based on the premise that our economies have digitised to a large extent, and hence, the TPP contains provisions on agriculture as well. The TPP tries to combat barriers to the growth of digital economy, and the D2D provides the most modern and the highest standard of such provisions. The D2D tenets can be divided into three categories:

1. Provisions to ensure the internet is open and safe, and an effective channel for trade and services.

2. Provisions to combat protectionist and restrictive provisions of member nations. The D2D talks about eliminating rules that seek to make foreign companies localise their data by building expensive data centers in every market they seek to serve. Further, TPP also seeks to prevent countries from 'forcing' foreign companies from transferring their technologies and production processes as a pre-condition for doing business there.

3. Provisions on IPRs to 'build a level playing field' in order to 'protect' innovators and creators in the digital space.

“ ...The TPP rules on enforcement of IPRs are strong and balanced and embody the TRIPs standards. For instance, countries are required to to impose criminal penalties on trade-secret violations such as cyberhacking.”

He added:

“We believe these rules are the foundation for next 20 years of the digital economy. To make sure that India does not fall behind we want to work with India (for the adoption of these rules). We're encouraged by the new government's programmes and the PM's engagement with US and silicon valley leaders.

We encourage India to level the playing field. To that end the USTR is working with the Indian Ministries of Communications and IT, and Commerce and Industry to exchange practices for building open markets. We want to work together in eliminating localisation policies given that how a lot of IT companies have established investment heavy R&D centers in India, and they rely heavily on the free flow of cross border data. Imposition of localisation of data would be detrimental in this age of cloud-computing. We're aware that the Indian government is reviewing its policies on cloud-computing and encryption, and we encourage the government to consider the implications of the such policies carefully, for India is also a leader in global IT and would be a potential framework setter at that.”

The D2D also endorses elimination of custom duties on ICT products, and the Ambassador added that the US was very pleased to see India deposit their instrument of accession on the Trade Facilitation Agreement with the WTO. The US has been pleased to see India's ratcheting up its norms for IPR protection. He mentioned that the two countries held a successful copyright workshop earlier this year, and later this year they plan to conduct a workshop on trade secret protection. The D2D also says that conformity assessment procedures are excessive and should be eliminated. This emerges from US' IT industries concerns on the compulsory registration of ICT products that required re-testing in Indian labs.

He made a case for opening up Indian markets by quoting a study which revealed that the Indian market for ICT products is worth 65bn dollars, while the global market stands at 2 trillion dollars. So while India could leverage its exports to meet the demand, the question remains if we want to foster a market based on openness. In his opinion, openness has enabled the IT sector in India to access other markets. However, he observed that countries were erecting barriers to this openness by restricting the cross-border free-flow of data, particularly and this is where the TPP assumes importance. The real challenge now is for the US and India to prepare their own version the the D2D.

On the route of D2D, the Ambassador was largely optimistic:

“The TPP has Obama's backing and the US Congress should ratify the deal before the elections. Other TPP members have already initiated steps to ratify the deal in their countries. For phase II, 13 non-member countries have already approached the US to be a part of TPP since the deal was concluded.”

Ambassador Shyam Saran

He began by stating that the India-US engagement on digital economy would become an area of close cooperation for US-India relationship. A few years ago the US pharma was unhappy with Indian generics, and this tussle left a bad taste between the countries, and also spilled over into the political side. Disagreements on several issues such as IPR, WTO subjects, etc still persist, despite some developments reflecting mutual trust and confidence (for instance the counter-terrorism initiative).

He welcomed potential cooperation in the digital field, because that would dispel the negativity and prevailing perception of India and US not being on the same page. The one area that has been a shaky pillar is the trade and economic relationship. In his frank opinion, the Indian establishment perceives USTR's outlook on trade issues as quite adversarial. He was mindful of a developing India's unique needs and priorities:

“In regard to the differences between India and US on trade and economic issues, it is not surprising because we must also be mindful of the reality- we are a developing country, wheras the US is highly developed and technologically advances - thus, we need different lenses for each. This is something we need to address, (remember how we acknowledged and fixed this in our defence relationship re the nuclear deal). The lesson that I draw is that here is an area critical to both countries' growth, and we need to address this differential aspect...”

According to him, right now India has an ambiguous position on the TPP. Holleyman had mentioned that the deal was based on an open platform, and Shyam pointed out that it was in fact conceived through closed door negotiations. It is common knowledge that rules at TPP were arrived at through complex negotiations between 13 countries, which surely was a process of complex give and takes. At this stage, it was not possible for India to look at one chapter and agree to meet the “gold standards” set in it.

According to him, D2D was important to the US solely in terms of trade benefits for its own businesses. He said that to convince the Indian government, the USTR will have to first convince the Indian IT industry the D2D benefits- which he was skeptical of. The reason was that this 'opportunity' comes across as a clear case of double-standards when the US talks about lowering barriers in India, and on the other hand is increasing barriers on its own shores (several pending bills in the US Congress indicate this). Similarly, immigration troubles for the Indian talent pool have only gone up. The other aspect he raised was on localisation and IPRs. He said that while stands on these issues were being formulated, it should also be expected that the government will take into account concerns of privacy and security. In the US itself, the US treasury has said in regard to banking and financial transactions localisation may be necessary.

He closed by offering an alternative route to the US – one of working with India as a partner in the Digital Economy instead of fixating on barriers and/or nitpicking on Indian legislations. This would be a more sustainable way to capitalise on India's growth potential and align with its digital future.

Samir Saran

Samir responded to the discussants by offering his thoughts (and questions) on D2D and the digital economy, broadly:

“...Can the digital space be a new space for a partnership? Three stories are important in the context of a trade document:
First is dominated by access – India is seeing 6 million new internet users every month and most of them are on low-cost mobile devices. Can a trading normative process allow to continue this phenomenon as it is?
Second is opportunity – India is already responding to investment flows. In terms of privacy and security – if India believes that it can become the digital infrastructure hub, it will need to develop world-class encryption tools. Similarly in terms of free-flow of information, when Obama and PM met they endorsed the same. So it is a step back from localisation, anyway. So you see India changing positions to make the atmosphere more business conducive.
Third is security – How can you make free-flow of data uni-directional? Why is it that you want data to flow unfettered when it creates value, but you are creating barriers for giving data for security purposes?...

...Further, in a phase when the mood worldwide is in favour of de-globalisation, will hyperglobalisation through FTAs work?...”

Finally, Holleyman acknowledged that historically India and US have had differences, but with the digital economy perhaps they can forge some approaches. He accepted that some of the points were written squarely for the US tech sector, but he hoped that the other 11 partners of the TPP will come out with what the D2D means to them.

For more details visit https://cis-india.org/a2k/blogs/ustr-elaborates-the-two-dozen-digital-rules-of-club-tpp

Using the Wikimedia sphere for the revitalization of small and underrepresented languages in India

subodh — 2024-02-10T04:35:45Z

This report explores opportunities within the Wikimedia movement and projects to help revitalise small and underrepresented languages in India and provide recommendations to CIS’s Access to Knowledge team in furthering this effort. The report is mainly based on a roundtable conversation on Digital Access in Bhubaneswar with a diverse range of backgrounds and professions, including independent researchers, representatives from non-profit organizations, retired government officials, Wikimedia contributors (both Odia and Santali), ecological activists, directors of research institutes, consultants, and journalists. This was organized by the Access to Knowledge team of CIS in collaboration with Vasundhara, Bhubaneswar.

This strategic note discusses a broad program idea of offering barrier-free open access to resources in various underrepresented languages in India.

Languages spoken in the Republic of India belong to several language families, the major ones being the Indo-Aryan languages spoken by 78.05% of Indians and the Dravidian languages spoken by 19.64% of Indians. Languages spoken by the remaining 2.31% of the population belong to the Austroasiatic, Sino–Tibetan, Tai–Kadai, and a few other minor language families and isolates. According to the People's Linguistic Survey of India, India has the second highest number of languages (780), after Papua New Guinea (840). Ethnologue lists a lower number of 456.

The UNESCO endangerment classification is as follows:

Vulnerable: most children speak the language, but it may be restricted to certain domains (e.g., home)
Definitely endangered: children no longer learn the language as a 'mother tongue' in the home
Severely endangered: language is spoken by grandparents and older generations; while the parent generation may understand it, they do not speak it to children or among themselves
Critically endangered: the youngest speakers are grandparents and older, and they speak the language partially and infrequently
Extinct: there are no speakers left

North-East India is home to more than 200 languages, out of which 82 are listed as Vulnerable, 63 as Definitely Endangered, 6 as Severely Endangered, 46 as Critically Endangered and 6 as Extinct (The Guardian Dataset). Arunachal Pradesh is the state with the highest number of languages, with as many as 66 languages spoken there, while West Bengal has the highest number of scripts, nine, and around 38 languages.

The state of Odisha has 62 Scheduled Tribes who speak as many as 74 dialects. Their ethos, ideology, worldview, value orientations and cultural heritage are rich and varied. Odisha has the unique distinction of having 93 different Scheduled Caste communities spread over 30 districts and 314 blocks of the state having different dialects. Apart from the languages of the North-East and the state of Odisha, there are several other languages all over India that deserve better representation on the Internet. While a handful of these languages enjoy status and visibility as official languages of the states and thereby hold some currency as widely spoken languages in their linguistic territories, there are many more languages that do not have speakers counting beyond a few hundred. Examples include the Bellari language (Spoken in Karnataka by 1000 speakers), the Toda language (Spoken in Tamil Nadu by 1600 speakers) and the Naiki language (Spoken in Maharashtra by 1500 speakers). What these languages do share in common with the languages of the North-East mentioned earlier is that they all lack free and open source knowledge and data.

Some of these languages are the official languages of the states and are widely spoken in this region. On the other hand, some of the languages have a few hundred native speakers. However, irrespective of the size of the native population or official status of the language, they all lack free and open source knowledge & data.

These languages show a range of marked cross-linguistic features which pose several interesting questions to Linguistic theories and speech processing research. Moreover, the close geographical proximity of these languages makes them vulnerable to changes in multiple linguistic levels, making these languages an excellent resource to study language change. Despite this, these languages severely lack digital preservation. One of the major reasons that contribute to the lack of resources is the difficulty in human access to some of the areas in these regions. Moreover, with English and Hindi being used as a lingua franca in these regions, the actual number of speakers proficient in their native language is much fewer than the number shown in the census reports. This makes it more important than ever to initiate a preservation process which does not primarily depend on fieldwork while also increasing the presence of the language in the digital sphere.

As language technologies advance and more sophisticated tools are built using Artificial Intelligence, the divide between low resource languages and others is likely to get even larger as a common prerequisite of these advanced systems is the existence of a large amount of digital data. Low resource languages are at a risk of being left behind.

Research on these languages by researchers are mostly conducted by collecting data personally, which causes a huge hindrance to the research process, as most of it remains as a private collection or published in closed journals. Moreover, data collection through fieldwork is particularly challenging in this region due to the restricted access to most of the disturbed areas.

The goal of this program is to facilitate the study of these languages by making existing resources discoverable and building open-source structured datasets and tools using the Wikimedia sphere to enrich the language research landscape of small and underrepresented Indian languages.

Role of CIS-A2K

To design and commission relevant research studies in collaboration with language communities to define the premises of the program. The plan is to work with languages which are being written in single or multiple scripts in the pilot phase.
To develop strategies regarding the integration of language datasets with Wikimedia projects
Skill building of volunteers and community leaders in Wikimedia projects
Structure of local knowledge to be compiled for contribution
To identify the specific Wiki projects such as Wikipedia, Wikimedia Commons, Wikidata, Lingua Libre etc to build the archives of these languages
Designing outreach and knowledge dissemination processes
To develop partnerships with other academic, social, cultural and research institutions in the language sector for the sustainability of the project
Material support - Sound recorders, microphones, hard discs, laptop, scanner, internet hardware
Financial support - Remuneration of intern/fellow, internet data recharge

Specific objectives

Empowering the communities by enhancing digital literacy and connecting them with the world of knowledge and people outside.
Revitalizing/enriching the languages by increasing their use, coverage and depth using technological interventions.
Creating an ecosystem for developing language learning resources and tools; particularly, in the context of the New Education Policy.
Enabling scholars and researchers to overcome the challenge of finding appropriate data and expanding the knowledge on these languages.
By using the Wikimedia sphere, the infrastructural and technological support is secured, so that these languages are able to function in the digital world.

It is important to realise that these objectives can introduce new dynamics into other spheres of activity, such as education and the development of language.

Methodology

Our target languages broadly belong to two sets:

Languages which are primarily spoken in various states of India and have some or no digital presence on the internet.
Endangered languages which have extremely limited or no digital presence.

Survey of ongoing work

Several individuals and institutions are working on languages across the globe. There are significant initiatives in India also to revitalise the small languages in the digital sphere. Some of these are listed in the reference section at the end. An exhaustive survey of all such efforts will be done to map the present status as well as a listing of stakeholders. The target languages for A2K’s future work and the potential collaborators will also be identified through these exercises.

Digital Dictionary Making

A dictionary is a vital resource for any language learning. The idea of collaborative dictionaries using platforms like Wiktionary or Wikidata Lexemes eliminates the need for expert lexicographers and terminologists and rather follows the method in which the users enter data as new entries, definitions, and so on, and the same is reviewed by editors, once published. An offline e-dictionary application using this dataset could be developed to overcome the problem of sparse internet connectivity where the user is only expected to download & install the application once and use the dictionary offline at any moment.

Data Acquisition Strategies

Leveraging Crowdsourcing using LinguaLibre for the creation of Speech CorporaGiven the scarcity of text and speech corpora for these low-resource languages, the main potential source for dataset creation is by crowdsourcing.
Using Optical Character Recognition techniques -

The digitisation of texts in the public domain would be done and made available freely by uploading them on Wikimedia projects. The digital copy will be made machine-readable using Optical Character Recognition (OCR).

Processing the acquired data

Preprocess
Processing Speech Corpora
Processing Bilingual Parallel text Corpora

Housing datasets

Wiki Commons for media files
Wikidata for Lexemes
Wikisource for texts

Capacity Building workshops

Promoting the language among the young speakers of the community, since they are the future of the language and if it survives, it will belong to them.

Help language speakers possess up-to-date digital competencies and feel confident about them to actively participate in the digital world and increase content in their own native language.

Promoting contributions on platforms like Storyweaver, Pratham Books, Eklavya etc.

Promote the upskilling of native speakers and other disseminators

Facilitate knowledge exchange through participatory mechanisms both virtually and face-to-face.

The potential communities would be introduced to Incubator for building new Wikimedia projects

Educational development

Applying Open access philosophy to advance language pedagogy.

Develop language learning resources and tools, particularly, in the context of the New Education Policy.

References

Wikipedia articles
SCSTRTI, Odisha - https://www.scstrti.in/index.php/resources/mle-initiative/bilingual-dictionaries
Most populous languages of Odisha - https://commons.wikimedia.org/wiki/File:Languages_of_Odisha.svg
People’s Linguistic Survey of India - https://www.peopleslinguisticsurvey.org/
The state and fate of linguistic diversity and inclusion in the NLP world - https://aclanthology.org/2020.acl-main.560/
Bhasha India - https://www.microsoft.com/en-in/bhashaindia
Omniglot - https://www.omniglot.com/index.htm
Bharatavani - https://bharatavani.in/
Storyweaver - https://storyweaver.org.in/
Dimasa Thairili - https://www.dimasathairili.com/
SIL International - https://www.sil.org/
Ethnologue - https://www.ethnologue.com/
Global Recordings Network - https://globalrecordings.net/en/
Glottolog - https://glottolog.org/
Endangered Languages Project - https://endangeredlanguages.com/

This is a report by Subodh Kulkarni with editorial oversight and support by Tanveer Hasan and Soni Wadhwa. Click to download the PDF here.

For more details visit https://cis-india.org/a2k/blogs/using-wikimedia-sphere-for-revitalization-of-small-and-underrepresented-languages-in-india

Using Kannada in technology made easier with smartphones

praskrishna — 2016-11-01T05:19:17Z

With the IT revolution, many believed that the younger generation would prefer to type and communicate in English than Kannada.

Dr. U.B. Pavanaja was interviewed by the New Indian Express. The article was published on November 1, 2016.

But U B Pavanaja, a member of Kannada Software Committee and a Kannada Wikipedia administrator, believes with latest technology, the use of Kannada has only been increasing. As the state celebrates Karnataka Rajyotsava today, Ashwini M Sripad spoke to Pavanaja on adapting Kannada language to the latest technology.

Where does Kannada stand when it comes to adopting technology?

Quite good. But not the best. Most tools needed to use Kannada in technology are available now. They are almost perfect.

Has there been any change in the use of Kannada in computer/mobile by youngsters in the last decade?

Yes. Due to the availability of Kannada input methods, and advent of smartphones, many youngsters are now using Kannada on their computers and smartphones. More people are typing in the Kannada script itself.

What should the state government do to popularise Kannada in technology?

A lot needs to be done. There was a committee to look into the standardisation and proper implementation of Kannada in technology. The committee submitted its report. The government implemented some parts of the report. After that nothing has been done. Now the committee does not exist. Standardisation is a continuous process. There must be a permanent committee to look into this. For example, domain names (website names) are available now in Hindi, Tamil, Bengali, etc., but not in Kannada. This is due to the fact that no one represents Kannada in meetings of W3C India, an international community to develop web standards.

How is the response to Kannada Wikipedia?

A lot of awareness has been created among people about the existence of Kannada Wikipedia in the last three years. But more needs to be done.

What can be done to improve it further?

At present, the articles are written by enthusiastic Kannadigas who are not really writers. They are doing this out of passion for the language. But well-known Kannada writers don’t edit Kannada Wikipedia. Kannada has a good number science writers, but they are not editing Kannada Wikipedia, which is very badly needed at this time. Also, there is no comprehensive printed encyclopaedia in Kannada for science and technology. The last one came out 18 years ago. Therefore students in Kannada medium schools need a good Kannada encyclopaedia. This requirement can be met by Kannada Wikipedia. But the number and quality of articles is far from sufficient. Writing for Kannada Wikipedia could be made compulsory for degree and post-graduate students to bring in some well-researched articles. Such programmes already do exist in some colleges in the state but we need more.

For more details visit https://cis-india.org/a2k/news/new-indian-express-november-1-2016-using-kannada-in-technology-made-easier-with-smartphones

US Copyright law faces constitutional challenge

sinha — 2016-08-11T13:28:13Z

In a major international development, the Electronic Frontier Foundation (EFF) has filed a lawsuit to strike down the provisions on Digital Rights Management(DRM) in the Digital Millennium Copyright Act. In this post, I discuss DRMs, the EFF lawsuit, and then draw upon the differences between the US and Indian copyright regime on DRM protection.

Originally published by Spicy IP on August 5, 2016. You may read EFF’s lawsuit here.

Decoding DRM

If you own a Netflix account and travel a lot, you may have been denied access to some TV shows depending on the country you logged in from. While that restriction can perhaps be gotten around by using VPNs, there exist other technological measures that prevent you from fixing your own automobile to sharing/making copies of an e-book that you supposedly bought. Such technological protection measures are commonly known as Digital Rights Management (DRM). These go back twenty years, and it was in 1996 when the first DRM appeared in the form of geo-access restrictions on DVD play.

Soon thereafter, it became de rigeur for businesses dealing in IP to apply all kinds of DRMs to their products. It was largely an embarrassing and a pointless saga of implementing software embedded restrictions to stem piracy (remember the Sony BMG rootkit fiasco?), given how blatantly they were discovered and circumvented. And now since technology is beginning to dwell even in our shoes, DRMs have been slapped onto these as well. So if you discover a bug causing a miscalculation in your step count, you are not only prohibited under law from probing the code and fixing it yourself, but you also may get jailed for doing so. Imagine such how such prohibition impacts and limits our daily lives and the work of professional researchers.

Clearly, DRM is not just a mere trifle to be brushed aside via smarter code– its ramifications go much farther. DRMs come with the problem of masking vulnerabilities, compromised security of the device and us er-privacy, and trampled consumer rights, fair use and free speech. Further, the poor design of DRMs makes them unable to distinguish between illegal use and fair-use. Progressive cutting down of users’ rights to store, reproduce, distribute media has become especially problematic for developing countries because of our greater dependence on free-er terms for sale, lending and donation. On the other hand, DRMs continue to become more ubiquitous(could be incorporated in the HTML 5 standard soon).

However, in an exciting development, the first major legal battle to kill DRM has begun!

Because finally in an unprecedented move, a constitutional challenge has been lodged in the US against DRM provisions, on the grounds that they restrict free speech and fair-use of copyright materials (the fair-use doctrine allows copyright law to co-exist with the first amendment). The complaint has been filed by EFF on behalf of Matthew Green (a security researcher) and Andrew “bunnie” Huang (a technologist)

The rejection that prompted a legal challenge..

Sections 1201-1205 of the Digital Millennium Copyright Act (DMCA) lay down provisions relating to circumvention of DRM. Uniquely, the DMCA vests power in the Librarian of Congress to periodically enact rules granting exemption from the anti-circumvention provisions to legitimate non-infringing use of works (known as DMCA Rulemaking). It was under this particular instance of rulemaking in 2015, wherein the Librarian failed to grant an exemption for “…speech using clips of motion pictures, for the shifting of lawfully-acquired media to different formats and devices, and for certain forms of security research.” The rejection triggered the challenge against ‘Rulemaking’, ‘anti-circumvention’ and ‘anti-trafficking’ provisions of the DMCA, namely sections 1201(a), 1203, and 1204 . (This exemption was applied for by EFF, which has been seeking (and been granted) exemptions since 2003.)

In fact, universally, DRM provisions pose questions of free speech, consumer rights, privacy and copyright law. In the following section I will examine and compare the US and Indian copyright regime on DRM protection.

WCT and DMCA were used to push DRM protection into Indian Copyright Act

The Indian Copyright Act, 1957 provisions on DRM are based in sections 2(xa), 65A and 65B, which were introduced through the Copyright Amendment Act, 2012. The sections define ‘Rights Management Information’, provide for ‘Protection of technological measures’ and ‘Protection of Rights Management Information’, respectively. It must be noted that the WIPO Copyright Treaty (WCT) was the first instrument to conceive rules on DRM protection (Articles 11, 12). US was the first country to import WCT provisions into its copyright law via DMCA, which even went above the WCT standards. Soon, Hollywood-backed USTR wanted India to follow suit, and the provisions were queued up for an amendment to India’s copyright law. Please note that India is NOT a party to the WCT, and was under no obligation to enact laws on DRMs. Nevertheless, the Indian provisions with some changes and added limitations were loosely lifted from the equivalent WCT articles.

It is worth noting that the Indian DRM provisions have better safeguards than the DMCA provisions:

1) The Indian provisions (s. 65A+ 65B) do not make building and distribution of circumvention tools illegal. Only the act of circumvention attracts criminal liability. However, there is a duty on the person facilitating circumvention for another person to maintain a record of the same, including the purpose for which the facilitation occurred. The purpose should not be expressly prohibited under the Copyright Act, 1957.

Regardless, being criminally liable for circumventing DRM is a major threat to small businesses and developers. In one instance, when some Indian developers had built an open source software “PlayFair” to bypass Apple’s FairPlay DRM, they were threatened with legal action under the US’ DMCA. Despite the DMCA having no jurisdiction in India, the developers shut shop.

2) Clauses 65A(1) and 65A(2)(a) confine violation of technological protection measures to rights enumerated in the act, only. This means that the section does not restrict circumventions which attempt to get access to the underlying work.

While India has not seen major challenges to this provision, in 2013 the Delhi High Court injuncted persons from jailbreaking into Sony Playstations. Amlan analysed the order and questioned it in terms of the Court finding the act of ‘modifying the playstation without Sony’s consent’ illegal. Because, if you read section 65A (emphasis supplied is mine):

65A. Protection of Technological Measures

(1) Any person who circumvents an effective technological measure applied for the purpose of protecting any of the rights conferred by this Act, with the intention of infringing such rights, shall be punishable with imprisonment which may extend to two years and shall also be liable to fine.

(2) Nothing in sub-section (1) shall prevent any person from:

(a) doing anything referred to therein for a purpose not expressly prohibited by this Act:

Provided that any person facilitating circumvention by another person of a technological measure for such a purpose shall maintain a complete record of such other person including his name, address and all relevant particulars necessary to identify him and the purpose for which he has been facilitated; or

(b) doing anything necessary to conduct encryption research using a lawfully obtained encrypted copy; or

(c) conducting any lawful investigation; or

(d) doing anything necessary for the purpose of testing the security of a computer system or a computer network with the authorisation of its owner; or

(e) operator; or [sic]

(f) doing anything necessary to circumvent technological measures intended for identification or surveillance of a user; or

(g) taking measures necessary in the interest of national security.

Clause (1) clearly states that the law is only applicable to such technological protection measures applied to protect any of the rights conferred by the copyright act. Which raises the questions of which rights are affected when OS of the playstation is modified, and how does the modification amount to copyright infringement? One may perhaps draw that the Court in this order placed the ‘consent’ of Sony above the law.

3) S. 65A(2) safeguards certain acts which also exist as exceptions granted in the Copyright Act. These enumerated acts may be performed without attracting liability: for instance, circumventions for purposes of encryption research, security testing, lawful investigation, evading surveillance by DRM are kosher. Note that s. 65A(2)(g) permits circumvention in the interest of national security.

(For a detailed exegesis of these provisions, please read this piece.)

A look at the draconian DMCA provisions

As I mentioned earlier, the DMCA provisions on DRMs are much stricter compared to the Indian copyright act. Both circumvention(s. 1201(a)(1)), and building and distribution of circumvention tools(s. 1201(a)(2)) are illegal and punishable. The DMCA also meticulously defines circumvention, in terms of “circumventing a technological measure” and “circumventing protection afforded by a technological measure.”

More alarmingly, these provisions envisage access controls as well as use controls. So a person decrypting a DVD to gain access to the work would be held liable for infringement (unlike in India where only the act of copying or modifying the work would trigger infringement). It is also worth noting that there is no clause stating that circumvention (and tools) of only those DRMs is illegal when the DRMs protect rights conferred under the DMCA.

While s. 1201(c) states that the section shall not affect “…rights, remedies, limitations or defenses to copyright infringement, including fair-use…” Further, there do exist exemptions to clauses(a)(1) and (2):

Exemption for nonprofit libraries, archives and educational institutions; and
Exemption for the purposes of law enforcement, intelligence and other government activities, reverse engineering (solely for the purposes of achieving interoperability), restricting internet access to minors, protecting personally identifiable information, security testing, encryption research, etc.

While the list seems to permit circumvention for a wide range of purposes and fair-use, the vague and narrow language has failed the implementation of these exemptions. EFF lists a bunch of these instances where the DRM provisions have been not necessarily used against pirates, but also scientists, consumers and legit competitors.

Further, the DMCA left it entirely to the US copyright agencies to carve exemptions for non-infringing uses of works on a triennial basis. This rulemaking procedure has received heavy criticism, and as a result of the 2015 rejection the Library of the Congress finds itself in a legal soup.

Finally, the EFF lawsuit also illustrates the violations of the plaintiffs rights to free speech and fair-use, as a direct result of the provisions and the Rulemaking process. Armed with a strong case, and as Cory Doctorow puts it, we may witness the eradication of DRM in our lifetime. And I will be following the developments closely and keep our readers updated.

For more details visit https://cis-india.org/a2k/blogs/us-copyright-law-faces-constitutional-challenge

US and EU blocking treaty to give blind people access to books

praskrishna — 2012-08-02T13:56:36Z

Copyright fears stall talks on books being translated into braille for blind and visually impaired people in the global south.

This article by Paige McClanahan was published in the Guardian on July 30, 2012. Rahul Cherian, a Fellow at CIS is quoted.

The US and the EU are blocking a treaty that would give the world's blind and visually impaired people – 90% of whom live in the developing world – easier access to published works in formats they can use.

A "treaty for blind people" has been under discussion at the World Intellectual Property Organisation (Wipo) since 2008, but negotiations have made little progress. In the latest round of talks in Geneva, which ended on Wednesday 25 July, negotiators deferred a decision on the issue once again, to the dismay of activists.

"This is not just a legal issue – for us, this is a moral issue. It's about human rights," said Teresa Hackett, programme manager at Electronic Information for Libraries, a non-profit group based in the Netherlands.

There are about 256 million visually impaired people in the developing world, according to an estimate by the World Health Organisation. In many rich countries, blind people have ready access to works that have been translated into braille and other accessible formats such as audio and large-print books, although, according to the EU, only 5% of books are accessible to blind people in wealthy states.

However, under existing copyright law, poorer countries can't access those translations without getting the express permission of the copyright holder. Few developing country governments have managed to do that, meaning that their blind and visually impaired populations are left with barely anything to read. The EU estimates that less than 1% of books are accessible to blind people in poorer countries.

"The Spanish organisation Once has well over 100,000 [translated] books that they would like to send to Latin American countries, but they can't simply because of this copyright barrier," said Dan Pescod of theRoyal National Institute of Blind People. Libraries in five Latin American countries – Colombia, Nicaragua, Mexico, Uruguay and Chile – have fewer than 9,000 accessible books between them, he said.

A treaty at WIPO could change that. A binding agreement would mean people in the global south could get immediate access to books that have already been translated into accessible formats in other countries. A treaty would also lead to enormous cost savings, as expensive translation has to be replicated in every country that wants to produce an accessible form of a given book.

The European parliament passed a resolution in February calling on the EU to support a binding treaty for the blind, but it does not appear to be having much impact. "The EU and the Americans are blocking the treaty – that's what's going on," said James Love, director of Knowledge Ecology International (KEI). "It's shameful what they're doing." He added that the administration of President Barack Obama has changed its position on the treaty over the past few years. In 2008 Obama's transition team were making positive noises, but since then the administration has become less enthusiastic.

Europe and the US are home to some of the world's biggest publishing companies, many of which don't like the idea of an international treaty that would restrict their intellectual property rights. Observers speculate that the Obama administration may be loth to upset the publishing industry, a major campaign supporter, this late in an election year. "What we can see in the [negotiating] room is that primarily it's the business interests that dominate," said Hackett.

Activists are hoping for a legally binding treaty, but US and European delegates have been pushing for a softer "instrument" that would offer only guidelines and recommendations.

"We really don't want to establish a precedent of developing a series of treaties that specifically focus on … limitations and exceptions to the rights of copyright owners," said Alan Adler of the Association of American Publishers, in an online interview with KEI. Discussions are due to begin again in November, after the US election.

Despite the setback, activists insist they will keep lobbying for a binding treaty. "We in developing countries have found our voice and we are not going to back down," said Rahul Cherian, of Inclusive Planet, an Indian nonprofit, in a statement to Wipo delegates last week. "When people are demanding their basic rights, no power in the world is strong enough to stop them getting what they want."

For more details visit https://cis-india.org/news/us-and-eu-blocking-treaty

Upload More Kannada Articles on Wikipedia

pavanaja — 2015-09-13T06:09:34Z

Uploading information in Wikipedia helps to develop language, said Indian Languages Programme Manager U B Pavanaja here on Saturday. The article was published in Indian Express (Mangaluru edition) on July 5, 2015.


Above: A scanned version of the article that appeared in Indian Express on July 5, 2015.

For more details visit https://cis-india.org/openness/news/indian-express-july-5-2015-upload-more-kannada-articles-on-wikipedia

Update on Publisher’s Copyright Infringement Suit Against Sci-Hub and LibGen in India

sinha — 2021-04-28T17:28:47Z

Anubha Sinha provides a summary of the progress of the copyright infringement suit against Sci-Hub and LibGen in India. This article was first published in InfoJustice on March 8, 2021.

This blog post is an update on the copyright infringement suit filed against Sci-Hub and LibGen in the Delhi High Court by Elsevier Ltd, Wiley India, and American Chemical Society.

In the first hearing in December, while the court ordered Sci-Hub to stop making new unauthorised uploads of the publishers’ content, it allowed the existing links to stay on, noting it was not urgent to remove content relating to decade-long infringing activity. LibGen did not appear before the court.

Indian science and academia realise that their right to research is at stake. In January, several Indian scientists and advocacy organisations applied to intervene in the case, to persuade the court to not issue an interim or permanent injunction for dynamic blocking of the websites.

One of the written submissions (filed by twenty scientists and a public health advocacy organisation) states that the two websites are the only access to educational and research materials for a big community of Indian researchers, scientists, teachers and students. And these have become indispensable during the pandemic.

This submission also highlights the position of leading science academies in the country – who in 2019 had advocated for making public-funded research openly accessible, as well as recognition of the affordability and availability problem in India’s current draft science, innovation, and technology policy. It shares analyses of the monopolistic barriers in academic publishing and extractive pricing, and their crippling impact in the Indian context.

They further argue that since the use of the websites is for research, which expressly falls within the ambit of statutory fair dealing, the charge of copyright infringement is not sustained. Nor have the publishers shown that Sci-Hub or LibGen users exploit the material for commercial gains. Additional legal support has been drawn from the DU photocopying judgment, Article 8(1) of the TRIPS Agreement, and jurisprudence around website-blocking in India.

In the hearing that followed, the judge noted that the issues in the case were ‘a matter of public importance’; hence, the court would hear all interested parties before issuing any new orders. LibGen still remained unrepresented, with the court noting that it had not been served properly yet.

At the time of writing this, Sci-Hub had filed its written statement (not publicly accessible yet). Alexandra Elbakyan has separately shared some thoughts on the case in an interview here.

Given the gamut of contentions, the case judgment will have implications for Indian copyright aspects such as: meaning of the statutory exemption for research and scope of fair dealing, and bar on circumventing technological protection measures – all while having to toe the WIPO Internet treaties, Berne Convention, and the TRIPS Agreement. Hopefully, these will be grounded in reflections on exploitative state of academic publishing system, duties of academic publishers, and distinction between piracy and sharing online.

The judgment will add to the state of our learning and research needs, and how copyright policy can support that, as this is the first time Sci-Hub and LibGen have been taken to court in a developing country.

Note: For an in-depth analysis of the social dimensions of the matter, please read this document prepared by Like-Minded IP Teachers’ Working Group on Intellectual Property and Public Interest.

Access the article on InfoJustice here.

For more details visit https://cis-india.org/a2k/blogs/update-on-publisher2019s-copyright-infringement-suit-against-sci-hub-and-libgen-in-india

University of Mysore Re-releases Kannada Vishwakosha (Encyclopaedia) under Creative Commons Free License

pavanaja — 2014-07-24T07:03:45Z

The University of Mysore and the Centre for Internet and Society co-organized the Open Knowledge Day in Mysore on July 15, 2014. On this occasion Mysore University released six volumes of Kannada Vishwakosha under the Creative Commons (CC) license.

Kannada Vishwakosha brought out by the University of Mysore can easily be termed as the best encyclopaedia in Kannada. It has been modelled after the famous Britannica encyclopaedia. Mysore University Vishwakosha has 14 volumes having a total of 13802 pages. The very first volume was brought out in the year 1969 and the final volume was released in 2004. Many famous Kannada authors, scientists, academicians and stalwarts from other fields have worked on creating this encyclopaedia. The print volumes of the first version of the encyclopaedia are out of stock now. Recently UoM has started revising and reprinting the encyclopaedia. So far 4 volumes have been revised, enhanced and published.

UoM believes in Open Access to Knowledge. It has put up the research outputs from its departments online for free access to the public. UoM has done these as a subscriber to the idea of Budapest Open Access Initiative. The Open Access Institutional Repository, of UoM, covers scholarly publications covering journal articles, conference papers, books, book reviews, presentations, reports and patents ever since UoM was established in 1916. Extending the philosophy of open knowledge to the Kannada encyclopaedia published by UoM becomes a natural extension. UoM is in the verge of celebrating its centenary soon and has taken many initiatives in that direction.

CIS-A2K has been in negotiations with UoM towards releasing of its high quality Kannada Vishwakosha (Kannada Encyclopaedia) under Creative Commons license. CIS and UoM signed a MoU on February 22, 2014. Here is the relevant extract from the MoU: "They will work together to digitize all encyclopaedic publications for which the copyright is owned by UoM, and re-release them under the Creative Common license (CC-BY-SA 3.0). The digitized content will be made available for everyone through free content distribution platforms like Wikipedia and Wikisource. The digitization will be done employing the global standard Unicode so that the content has longevity, is universally portable and is easily searchable. Both parties have joined hands to undertake the above in order to enhance digital literacy in the Kannada language and facilitate collaborative production and free dissemination of knowledge in Kannada to the students, academics, researchers and the wider public. The parties also believe that by reintroducing the knowledge in digital and openly accessible formats could significantly enhance the production of knowledge in Kannada and give a new lease of life to Kannada language in the digital era. The parties will co-design and jointly implement relevant programmes to achieve this objective." As part of this MoU, UoM agreed to release the first six volumes of Kannada Vishwakosha under CC.

Volume numbers 1, 2, 4 and 6 of Kannada Vishwakosha of UoM have been revised and published recently. A project page has been created in Kannada Wikipedia for this project. Kannada Wikipedians joined hands in the project. The project involved extracting the text from the soft copies of the files, converting them into Unicode, extracting articles from these files and uploading them to Kannada Wikisource.

A team of interns from Christ University had a major role to play in this development. These were students from the Wikipedia in Education Program that was conducted in Christ University during the academic period of 2013-14. These students took active part in the current project and uploaded about 1200 articles so far (till July 21, 2014).

Media Coverage

The event attracted very good media coverage. Leading English and Kannada dailies like Andolana Kannada, City Today, Deccan Herald, Hosa Diganta, Kannada Jana Mana, Kannada Prabha, Rajya Dharma, Samyukta Karnataka, The Hindu, The New Indian Express, Udayavani, Vijaya Karnataka, and Vijaya Vani published about this. Scanned versions of the published articles can be downloaded here.

Other Links:

UoM Kannada Vishwakosha conversion project page in Kannada Wikipedia - http://bit.ly/mysoreunivwp
Articles from UoM Kannada Vishwakosha in Kannada Wikisource - http://bit.ly/mysoreuniv
Category UoM Kannada Vishwakosha in Kannada Wikisource - http://bit.ly/mysoreunivws
For pictures from the Open Knowledge Day event in Mysore - https://commons.wikimedia.org/wiki/Category:Mysore_University_Open_Knowledge_Day

For more details visit https://cis-india.org/openness/blog-old/university-of-mysore-releases-kannada-vishwakosha-under-cc-license

Understanding the Data Gaps on Wikidata Concerning Heritage Structures of West Bengal

Bodhisattwa Mandal — 2021-05-15T12:31:40Z

This is a short study on identifying the data gaps related to heritage structures in West Bengal on Wikidata, and potential strategies to address the same. The report is authored by Bodhisattwa Mandal, with editorial oversight and support by Puthiya Purayil Sneha and external review by Sumandro Chattapadhyay. This is part of a series of short-term studies undertaken by the CIS-A2K team in 2019-2020.

Wikidata is a free and open repository of structured and linked data, hosted by the Wikimedia Foundation, built collaboratively[1] by human volunteers and robots from all over the world[2]. This platform, with an initial intention to be used within Wikimedia projects as a high quality secondary database [3], first started by centrally linking Wikipedia articles about the same topics in different languages[4][5][6][7][8], but soon it started linking with external databases.

Introduction to Wikidata

Wikidata is designed to be structured as a Resource Description Framework or RDF model which describes statements in the form of triplets of subject–predicate–object. In Wikidata, subject–predicate–object is termed as item–property–value. Items on Wikidata can represent every possible object, concept or topic in human knowledge which passes a certain threshold of defined notability and are represented by unique Q numbers. The actual data of an item is called value, which is pre-defined by the data type, be it strings, numbers, dates, url links, coordinates, musical notations etc. or even other items. Properties, represented by unique P numbers, describe the data value of items. The items, properties and values are language independent and thus totally machine-readable, although for human comfort and understanding, one can describe items in their own languages by adding or translating labels, descriptions or aliases.

Due to the machine-readable triplet structure of Wikidata, the database can be easily queried to find answers, which might not be otherwise possible from a list of unstructured contents such as Wikipedia articles. To retrieve and manipulate RDF data formats in triplets, we require a semantic query language for RDF databases named SPARQL. Through Wikidata query service, one can use SPARQL and retrieve data and the prevailing gaps on Wikidata and visualize in different ways.

Wikidata in West Bengal, India

Massive imports of coordinates for places in West Bengal happened between October 2018 and May 2019 on Wikidata as reflected by the map generated using Resemble.js

Wikidata activities around India have been organized around India for almost 4 years under the WikiProject India umbrella. Targeted approaches to fill data gaps on different topics have been pursued through data-thons and campaigns in these years and community strength has been aimed to increase through workshops and skill sharing initiatives.

Being part of that initiative, the Indian state of West Bengal has seen a lot of activities around Wikidata in recent years. Under the WikiProject umbrella, Wikidata volunteers have been working together to build data on different topics related to the state, its demographics, culture, heritage, education, health, politics, language etc. As heritage has been the prime focus of the Wikimedia community members of West Bengal, in this essay, we will identify the data gaps related to the topic through SPARQL query and explore reasons for the same, if any, through interviews of active volunteers who have been working on this area for years.

Wikimedia community members have been working on documenting different forms of heritage since 2011, when they organized Wikipedia Takes Kolkata photo-walk for the first time. Since then, they have organized eight more Wikipedia Takes Kolkata photo-walks, 11 Wiki Exploration projects in 9 districts of the state, 2 editions of prestigious Wiki Loves Monuments in India 2018 and 2019 and several other documentation projects organized organically or single-handedly and by doing so they have uploaded several thousands of photographs related to heritage structures and GLAM collections on Wikimedia Commons.

In this essay, we will focus on the photo-walks and explorations which were conducted to document heritage structures of West Bengal. We will focus on two basic types of data which should be there in every dataset on heritage structures, i.e. a) location, and b) image, and we will find out if there is any significant gap there using SPARQL queries.

Photo-walks and Wiki Explorations in West Bengal

Map of KMC heritage buildings generated from Wikidata query https://w.wiki/Tir

Let’s start with the nine consecutive series of Wikipedia takes Kolkata photo-walks which aims to photo-document heritage buildings and structures of Kolkata. To understand the data gap related to the heritage buildings, we will examine the presence of graded heritage buildings and structures enlisted by Kolkata Municipal Corporation (KMC) on Wikidata through different SPARQL queries. Wikidata now contains 923 heritage buildings and structures listed by KMC, but out of them 26.65% have images and only 18.53% have coordinates.

Although 81.47% of the items of the heritage structures were missing coordinates, but they gave fairly good idea about their location, all of the items had municipal wards and streets connected with them, utilizing which, photographers and travellers are expected to explore the sites easily. However, while testing the items of the wards, it was noticed that however all the 144 wards contain coordinates, but they all lack a crucial property which can denote their area of location i.e. the geoshape data. While coordinates can denote the exact location of certain parts of an area, it is misleading when it comes to a larger area, which requires geoshape to better describe the location. While testing the street data, it was found that both geoshape and coordinate data are lacking for the streets, which makes them extremely difficult to locate.

Map of temples in West Bengal generated from Wikidata query https://w.wiki/Tj7

For the last 3 years, Wikimedia volunteers from West Bengal have also been involved in Wiki Exploration projects to remote parts of the state documenting temples, mosques, sculptures etc., many of which have not been documented online before. Few hundreds of heritage structures in 9 districts of the state were documented and thousands of photographs under this project have been uploaded to Wikimedia Commons. Now, if we test the Wikidata presence of the temples situated in West Bengal, it can be noticed that 435 temples have items, out of which only 196 items have images and only 79 have coordinates. however 302 of them have their location pin-pointed to the village, ward, town or city level. Similar to the previous case, although there are 40,359 items for villages located in West Bengal, only 0.017% have coordinates while none have geoshape data.

From the above two scenarios, it can be easily concluded from the SPARQL queries, that there has been a significant amount of data gap. Both the datasets contain significant lack of location data and images. The second scenario even lacks data on the temples itself.

Challenges of Contributing to Wikidata in/from West Bengal

Now, to understand why there are huge gaps in the data, we have interviewed four volunteers from West Bengal who are involved in these two kinds of projects, three of them are Wikimedia contributors for five-ten years and one of them is relatively new to the movement. They all upload heritage photographs to Wikimedia Commons and 2 of them contribute to Wikidata. All of them agreed that due to lack of suitable hardware, they could not document the exact coordinate data while photo-documenting heritage structures. GPS devices or full-frame cameras with built-in GPS are expensive and are not affordable to many. Interviewees have also pointed out that due to lack of proper training on how to document heritage structures properly, photographers and amaetur researchers miss out vital points of documentation and thus increase data gaps. Restricted access to private heritage structures like temples maintained by families or private heritage buildings and their documents, lack of proper existing documentation along with analogue and digital metadata, and rapid destruction of built heritage due to lack of maintenance or improper restoration procedures etc. are also the reasons for data gaps. While answering the question about why photographs are not converted fully into data, they point out that it might be a burden for photographers to learn about data entry in Wikidata, as this is out of their area of interest and workflow. As noted by an interviewee, ‘the nature of work for Wikidata does not match with photographers' workflow.’ However, they also stressed on the need to conduct training programmes on Wikidata for photographers and interested people involved in documentation to let them know the importance of structured data in the area of heritage documentation.

Recommendations

From the observations of this short study, it is recommended that volunteers working on heritage documentation in West Bengal should be supported with suitable hardware to document coordinates. Frequent training programs should be conducted, preferably by experts, for volunteers on how to document heritage structures in a professional way, so that data gaps remain minimal. Training on Wikidata should be conducted for photographers to let them understand the importance of structured data in the field of heritage documentation. It is also recommended to increase interaction among the Wikidata and Wikimedia Commons volunteers, to understand each other's work flow and strategically modify those to provide optimal results.

References

[1] Vrandečić, Denny (2012). "Wikidata: a new platform for collaborative data collection". Proceedings of the 21st international conference companion on World Wide Web - WWW '12 Companion. Lyon, France: ACM Press: 1063. doi:10.1145/2187980.2188242. ISBN 978-1-4503-1230-1.

[2] Vrandečić, Denny; Krötzsch, Markus (2014-09-23). "Wikidata: a free collaborative knowledgebase". Communications of the ACM. 57 (10): 78–85. doi:10.1145/2629489.

[3] Vrandečić, Denny (2012).

[4] Roth, Mathew (30 March 2012). "The Wikipedia data revolution". Wikimedia Foundation Blog.

[5] Pintscher, Lydia (14 January 2013). "First steps of Wikidata in the Hungarian Wikipedia". Wikimedia Deutschland Blog.

[6] Pintscher, Lydia (30 January 2013)."Wikidata coming to the next two Wikipedias". Wikimedia Deutschland Blog.

[7] Pintscher, Lydia (15 February 2013). "Wikidata live on the English Wikipedia". Wikimedia Deutschland Blog.

[8] Pintscher, Lydia (6 March 2013). "Wikidata now live on all Wikipedias". Wikimedia Deutschland Blog.

Notes

[1] The query results were generated during early 2020. The results may vary at the time of publication of this article.

[2] See Annexure I for the interview questionnaire.

[3] Read this report on Wikimedia Meta-Wiki here.

For more details visit https://cis-india.org/a2k/blogs/understanding-the-data-gaps-on-wikidata-concerning-heritage-structures-of-west-bengal

Unable to read Odia on your android device? Don’t fret!

praskrishna — 2015-12-15T08:04:39Z

If you get only boxes in place of Odia fonts in your Android device then it does not support the language. So you need to install Odia font in your smart phone; one way is to root it, but it’s not without cons.

The article by Ruby Nanda was published in Odisha Sun Times on September 28, 2015. Subhashish Panigrahi was quoted.

Rooting means breaking and getting full rights into the entire operating system of your Android. If done right it can turn you into a super user and open a wealth of opportunities with your handheld device. But, rooting is a complex process and definitely not for a newbie, as rooting leads to loss of warranty, security issues and a wrong move can turn it into a paperweight.

“Rooting is not advisable as it is bit complicated and turns your phone warranty void”, says Subhashish Panigrahi, Programme Officer at the Centre for Internet and Society, an NGO. By far the easiest way to read Odia is by installing Firefox Browser for your android mobile, he added.

Nihar Kumar Dalai, IT professional, has found an easy hack and with Panigrahi, he has designed a free licensed tutorial by which one can easily read Odia language in their smart phones.

“Odia fonts are supported only in the latest android 5.1.1 update, but people using android devices with older version may not have Odia fonts and can see only the boxes. We see many people seeking help to resolve this problem on Twitter and Facebook. With missing Odia fonts, people may end up writing Odia in Roman script, said Dalai.

“There has been very positive response from people who have tried this method. I’m happy to play a very small part for this cause, the IT professional added.

So if you are unable to read or write Odia in your android handheld then no sweat, just try out these simple steps and enjoy the fun of reading and writing Odia in your mobile.

Install Mozilla Firefox browser for Android on your phone from Google Play.
Launch Firefox and go to the Oriya fonts package Add-Ons page and select “Add to Firefox”
Click on Install
Eureka! Now Odia fonts appear on your android device instead of unrecognizable boxes.

Click here to watch the tutorial:

https://or.wikipedia.org/s/ucf

Once you’re able to read and write Odia, you can use any online Odia transliteration service e.g. TypeOdia (on Firefox browser), iBUS on Linux, Microsoft’s Indic language Input Tool, Google Input Tool.

P.S: This method only works on Firefox Browser for Android and not on any other Apps. Android jellybean 4.3 version also supports Odia but there might be issues which are fixed by 5.1.1.

For more details visit https://cis-india.org/openness/news/odisha-sun-times-september-28-2015-ruby-nanda-unable-to-read-odia-on-your-android-device

Ubiquity, Mobility, Globality: Charting Directions in Mobile Phone Studies

praskrishna — 2014-12-04T16:27:26Z

Nehaa Chaudhari made a presentation at the Ubiquity, Mobility, Globality : Charting Directions in Mobile Phone Studies Conference. This was organized by the Center for Global Communication Studies at the Annenberg School for Communication, University of Pennsylvania, Philadelphia on November 6 and 7, 2014. Nehaa was on a panel titled Mobile and its Effects on Global Markets and made a presentation on Pervasive Technologies: Access to Knowledge in the Workplace.

Nehaa Chaudhari's presentation can be downloaded here (PDF, 518 KB). Click here for the full programme. Download the agenda here.

Mobile phones are tools for activism and civic participation, surveillance and repression, market making and market disruption. In Ithiel de Sola Pool’s memorable phrase, there have been few “technologies of freedom” that match the consequences of these new instruments and the infrastructure that supports them. This conference examines dimensions of the social, political, and economic effects of the global ubiquity of mobile phones:

What are the affordances and limitations of mobile phones in development?
What is the impact of mobile phones on socio-political change?
How do mobile phones continue to shape our civil liberties?
What are the geo-political consequences of these mobilities?
How does mobile phone adoption challenge and support market innovation?

To tackle these questions, this conference brings together voices from the academy, civil society, and industry—all to examine the heterogeneous sources and consequences of mobility’s diffusion. The goal of this conference is to further interdisciplinary and comparative approaches to the understanding of the mobile phenomenon and to chart directions in mobile phone studies. The conference is funded by the Provost’s Global Engagement Fund, the Center for Global Communication Studies, and the Project for Advanced Research in Global Communication and the program reflects the input of several Schools at Penn, including the Annenberg School for Communication, Wharton, Law, and the School of Arts and Sciences.

For more details visit https://cis-india.org/a2k/news/center-for-global-communication-studies-november-6-2014-ubiquity-mobility-globality-charting-directions-in-mobile-phone-studies

U.S. support sought for treaty to allow blind people access to copyrighted works

praskrishna — 2012-08-01T09:44:47Z

Advocates of visual disability groups from across the world urged the United States to get off the fence at the global copyright negotiations in Geneva this week and actively back a strong treaty that allows blind people access to copyrighted published works.

This article by Rama Lakshmi was published in the Washington Post on July 24, 2012. Pranesh Prakash is quoted.

The proposed treaty would make it obligatory for countries to allow copyrighted printed published works to be converted into an accessible format for people with visual and reading disabilities and shared around the world without seeking permission from the copyright holder.

The United States and European Union agree in principle to disability access but are not committed to a legally binding global treaty. Disability advocates at the ongoing negotiations of the United Nations agency, the World Intellectual Property Organization, say that if the U.S. backs their demand, the European Union will automatically fall in line.

“The American publishers industry, comprising of the publishing giants, does not want it to be a treaty and only want it to be a set of recommendations,” said James Love, director of the Washington-based nonprofit group Knowledge Ecology International that is part of the campaign in Geneva. “The U.S. has the biggest collection of accessible English language books. It all boils down to the American government’s will. Do you or do you not believe that the American libraries should cooperate with blind people in other parts of the world?”

But American publishers say they are opposed to a treaty that has the potential to set the stage for similar exceptions and limitations to the rights of copyright owners in other areas as well.

“We are not against allowing an exception for people with print disabilities, but our concern is that a treaty will establish a precedent that they will then apply in the other areas like educational uses, library and archives,” said Allan Adler, vice president of legal and government affairs at the Association of American Publishers in a telephone interview. “Generally, international treaties establish the minimal rights of the copyright owners first, and not the limitations and exceptions to those rights.”

Adler’s view was echoed in what a U.S. delegate, Justin Hughes, told negotiators in Geneva on Thursday: “We do not accept any form of linkage between the effort on behalf of the world’s print disabled people and any other project. To us, such a linkage between the print disabilities effort and an effort for business affairs would be unprincipled, it would be unethical, and the United States will not have any part of it.”

The U.S. government also is advocating a softer, nonbinding alternative to a legally binding treaty, delegates in Geneva say.

But many disability rights groups say mere recommendations place no obligations and would be toothless.

Disability advocates say that the needs of visually impaired people are being neglected in this battle over what legal shape the agreement ultimately takes.

“The lack of access to information and knowledge is central to the debate about exclusion of visually impaired people,” said George Abraham of Score Foundation, a New Delhi-based group that supports the campaign to produce a treaty.

Time is running out, advocates of the treaty say. The negotiations began as early as 1981 but have now reached a conclusive stage that could result in a treaty by next year. The Geneva discussions end Wednesday, and lack of consensus this week would put off the negotiations to 2014. By then, most negotiators would have moved on, treaty supporters say.

This urgency has driven developing nations like India to take a strong stand. While the exact number is uncertain, experts agree that India has a high proportion of the world’s blind population, with estimates ranging from one-quarter to one-half. G.R. Raghavender, who represents the Indian government at the negotiations, said the Indian delegation “will not return empty-handed.”

Earlier this year, India passed key amendments to its domestic copyrights law to permit people with visual disabilities to freely convert text material into an accessible format. But only a global treaty can allow visually disabled Indians to import and use accessible books without taking permission from the copyright-holder.

“The vast majority of visually disabled people live in poor, developing countries where very little money is spent on converting books into accessible formats, while they are much more readily available elsewhere,” said Pranesh Prakash, a lawyer at the Center for Internet and Society. “The treaty would end the book famine that they currently face.”

For more details visit https://cis-india.org/news/us-support-sought-for-treaty-to-allow-blind-people-access-to-copyrighted