Unrestricted grammar

In formal language theory, an unrestricted grammar is a formal grammar on which no restrictions are made on the left and right sides of the grammar's productions. This is the most general class of grammars in the Chomsky–Schützenberger hierarchy, and can generate arbitrary recursively enumerable languages.

Formal definition

An unrestricted grammar is a formal grammar $G=(N,\Sigma ,P,S)$ , where $N$ is a set of nonterminal symbols, $\Sigma$ is a set of terminal symbols, $N$ and $\Sigma$ are disjoint (actually, this is not strictly necessary since unrestricted grammars make no real distinction between the two; the designation exists purely so that one knows when to stop generating sentential forms of the grammar), $P$ is a set of production rules of the form $\alpha \to \beta$ where $\alpha$ and $\beta$ are strings of symbols in $N\cup \Sigma$ and $\alpha$ is not the empty string, and $S\in N$ is a specially designated start symbol.^[1]^:220 As the name implies, there are no real restrictions on the types of production rules that unrestricted grammars can have.

Unrestricted grammars and Turing machines

It may be shown that unrestricted grammars characterize the recursively enumerable languages. This is the same as saying that for every unrestricted grammar $G$ there exists some Turing machine capable of recognizing $L(G)$ and vice versa. Given an unrestricted grammar, such a Turing machine is simple enough to construct, as a two-tape nondeterministic Turing machine. The first tape contains the input word $w$ to be tested, and the second tape is used by the machine to generate sentential forms from $G$ . The Turing machine then does the following:

Start at the left of the second tape and repeatedly choose to move right or select the current position on the tape.
Nondeterministically choose a production $\beta \to \gamma$ from the productions in $G$ .
If $\beta$ appears at some position on the second tape, replace $\beta$ by $\gamma$ at that point, possibly shifting the symbols on the tape left or right depending on the relative lengths of $\beta$ and $\gamma$ (e.g. if $\beta$ is longer than $\gamma$ , shift the tape symbols left).
Compare the resulting sentential form on tape 2 to the word on tape 1. If they match, then the Turing machine accepts the word. If they don't, the Turing machine will go back to step 1.

It is easy to see that this Turing machine will generate all and only the sentential forms of $G$ on its second tape after the last step is executed an arbitrary number of times, thus the language $L(G)$ must be recursively enumerable.

The reverse construction is also possible. Given some Turing machine, it is possible to create an unrestricted grammar.

Computational properties

The decision problem of whether a given string $s$ can be generated by a given unrestricted grammar is equivalent to the problem of whether it can be accepted by the Turing machine equivalent to the grammar. The latter problem is called the Halting problem and is undecidable. LuZc is a functioning parser for unrestricted grammars.

Recursively enumerable languages are closed under Kleene star, concatenation, union, and intersection, but not under set difference; see Recursively enumerable language#Closure properties.

The equivalence of unrestricted grammars to Turing machines implies the existence of a universal unrestricted grammar, a grammar capable of accepting any other unrestricted grammar's language given a description of the language. For this reason, it is theoretically possible to build a programming language based on unrestricted grammars (e.g. Thue).

Chomsky hierarchy	Grammars	Languages	Abstract machines

Type-0 — Type-1 — — — — — Type-2 — — Type-3 — —	Unrestricted (no common name) Context-sensitive Positive range concatenation Indexed — Linear context-free rewriting systems Tree-adjoining Context-free Deterministic context-free Visibly pushdown Regular — Non-recursive	Recursively enumerable Decidable Context-sensitive Positive range concatenation^* Indexed^* — Linear context-free rewriting language Tree-adjoining Context-free Deterministic context-free Visibly pushdown Regular Star-free Finite	Turing machine Decider Linear-bounded PTIME Turing Machine Nested stack Thread automaton restricted Tree stack automaton Embedded pushdown Nondeterministic pushdown Deterministic pushdown Visibly pushdown Finite Counter-free (with aperiodic finite monoid) Acyclic finite

Each category of languages, except those marked by a ^*, is a proper subset of the category directly above it. Any language in each category is generated by a grammar and by an automaton in the category in the same line.

References

↑ Hopcroft, John; Ullman, Jeffrey D. (1979). Introduction to Automata Theory, Languages, and Computation (1st ed.). Addison-Wesley. ISBN 0-201-44124-1.

This article is issued from Wikipedia - version of the 12/5/2016. The text is available under the Creative Commons Attribution/Share Alike but additional terms may apply for the media files.

Unrestricted grammar

Formal definition

Unrestricted grammars and Turing machines

Computational properties

See also

References