parser: do not export tables

Signed-off-by: Jean Privat <jean@pryen.org>

lib: string does not need anymore to intrude array

since the rewrite of string, some time ago, it seems

Signed-off-by: Jean Privat <jean@pryen.org>

Merge: Utf8 strings

(Re?)Introducing Unicode strings (with UTF-8) with mandatory indexes for now, the module is incomplete yet (don't go and try to concatenate two UTF-8 FlatStrings, you'll be surprised by the result).

There's still some work to do on the global API, but here's a WIP version that should not break anything, any comments are welcome !

Pull-Request: #602
Reviewed-by: Jean Privat <jean@pryen.org>
Reviewed-by: Frédéric Vachon <fredvac@gmail.com>

Merge: Ropes optimizations

Small optimizations on Rope, significantly speeds-up concatenation and indexed access, however, slows substring.

Before :
 * `./substr_bench -m rope --loops 100000 --strlen 25 --ccts 10 NIT_GC_CHOOSER=large` => 0.12s
 * `./chain_concat -m rope --loops 100000 --strlen 25 --ccts 10 NIT_GC_CHOOSER=large` => 1.47s
 * `./iteration_bench -m rope --iter-mode index --loops 100000 --strlen 25 --ccts 10 NIT_GC_CHOOSER=large` => 20.95s

After :
 * `./substr_bench -m rope --loops 100000 --strlen 25 --ccts 10 NIT_GC_CHOOSER=large` => 0.36s
 * `./chain_concat -m rope --loops 100000 --strlen 25 --ccts 10 NIT_GC_CHOOSER=large` => 0.25s
 * `./iteration_bench -m rope --iter-mode index --loops 100000 --strlen 25 --ccts 10 NIT_GC_CHOOSER=large` => 1.47s

Pull-Request: #626
Reviewed-by: Alexandre Terrasa <alexandre@moz-code.org>
Reviewed-by: Jean Privat <jean@pryen.org>

Merge: Benchmarks string

After postponing for a while, here are a few micro-benches (concat, substring, iteration using indexes or iterator) for variants of Text available at the moment with a shell script for automation.

Pull-Request: #624
Reviewed-by: Jean Privat <jean@pryen.org>
Reviewed-by: Alexandre Terrasa <alexandre@moz-code.org>

Merge: mnit_simple: rename FDROID metadata to match the java_package

Pull-Request: #622

Merge: gitignore: some update

Pull-Request: #616
Reviewed-by: Lucas Bajolet <r4pass@hotmail.com>
Reviewed-by: Alexis Laferrière <alexis.laf@xymus.net>
Reviewed-by: Alexandre Terrasa <alexandre@moz-code.org>

Merge: c_src: update

A fresh regeneration of the c_src. It is the first one based on `nitg --semi-global`.
Developers of the compiler and the stdlib can now use more new and fancy features of the Nit language.

Pull-Request: #625
Reviewed-by: Lucas Bajolet <r4pass@hotmail.com>
Reviewed-by: Alexandre Terrasa <alexandre@moz-code.org>

lib/bufferized_ropes: Force insert_at for + operation

Signed-off-by: Lucas Bajolet <r4pass@hotmail.com>

benchmarks: Added script for all string-related benchmarks

Signed-off-by: Lucas Bajolet <r4pass@hotmail.com>

benchmarks/string: Added String benchmarks

Signed-off-by: Lucas Bajolet <r4pass@hotmail.com>

lib/standard/ropes: + operation in O(1) time now

Signed-off-by: Lucas Bajolet <r4pass@hotmail.com>

c_src: update

Signed-off-by: Jean Privat <jean@pryen.org>

tests: Test for UTF-8 Strings.

Signed-off-by: Lucas Bajolet <r4pass@hotmail.com>

lib/string_exp/utf8: Fixed print routine to support UTF8 strings.

Signed-off-by: Lucas Bajolet <r4pass@hotmail.com>

lib/string_exp/utf8: Output usable with UTF-8.

Signed-off-by: Lucas Bajolet <r4pass@hotmail.com>

lib/string_exp/utf8: to_upper/lower usable with UTF-8 strings.

Signed-off-by: Lucas Bajolet <r4pass@hotmail.com>

lib/string_exp/utf8: Implemented to_upper/to_lower on UnicodeChar.

Signed-off-by: Lucas Bajolet <r4pass@hotmail.com>

lib/string_ext/utf8: to_cstring will work on UTF-8 strings now.

Signed-off-by: Lucas Bajolet <r4pass@hotmail.com>

lib/string_exp/utf8: Substring now works with UTF-8 strings (pre-indexed).

Signed-off-by: Lucas Bajolet <r4pass@hotmail.com>

lib/string_exp/utf8: Adapted reverse service on UTF-8 strings.

Signed-off-by: Lucas Bajolet <r4pass@hotmail.com>

lib/string_exp/utf8: UnicodeChars can be tested for strict equivalence.

Signed-off-by: Lucas Bajolet <r4pass@hotmail.com>

lib/string_exp/utf8: Added routine to compute code point on a UTF-8 character.

Signed-off-by: Lucas Bajolet <r4pass@hotmail.com>

lib/string_exp/utf8: Adapted * for FlatString with UTF-8 chars

Signed-off-by: Lucas Bajolet <r4pass@hotmail.com>

lib/string_exp/utf8: Adapted the construction from a CString to work with UTF-8.

Signed-off-by: Lucas Bajolet <r4pass@hotmail.com>

lib/string_exp/utf8: Introducing UTF-8 basics for String.

Signed-off-by: Lucas Bajolet <r4pass@hotmail.com>

lib/string_experimentations: Added README for project

Signed-off-by: Lucas Bajolet <r4pass@hotmail.com>

lib/string_experimentations: Added module for importation of string_experimentations

Signed-off-by: Lucas Bajolet <r4pass@hotmail.com>

lib/standard/ropes: Added cache on indexed access.

Signed-off-by: Lucas Bajolet <r4pass@hotmail.com>

Merge: model: add `MType::as_notnullable` to remove the `nullable` modifier

Basically replace

~~~
if m isa MNullableType then m = m.mtype
~~~

by

~~~
m = m.as_notnullable
~~~

Pull-Request: #619
Reviewed-by: Lucas Bajolet <r4pass@hotmail.com>

Merge: type works: handle implicitly fixed formal parameters

~~~
class G[E: Int]
   # Here, since Int cannot have a subclass, then E == Int (implicitly fixed)
end
~~~

This series enhance the type system to understand this case, and give the user a warning when bounding formal parameter with final classes.

Pull-Request: #618
Reviewed-by: Lucas Bajolet <r4pass@hotmail.com>

Merge: Magic configuration for bash completion

Some bash magic to lazy load and configure bash_completion for nit.

Steps for a functional installation:

0. [if you have old binaries] `$ rm c_src/nitg`
1. `$ make`
2. [optional], put the `bin` directory in your PATH
3. `$ source misc/bash_completion/nit`
4. [optional] link (or copy) `misc/bash_completion/nit` in `/etc/bash_completion.d`, or source it in `~/.bash_completion`
5. profit

Pull-Request: #617
Reviewed-by: Lucas Bajolet <r4pass@hotmail.com>

mnit_simple: rename FDROID metadata to match the java_package

Signed-off-by: Jean Privat <jean@pryen.org>

bash_completion: add a magic script that do the bash_completion setup

Signed-off-by: Jean Privat <jean@pryen.org>

tests: update test_toolcontext

Signed-off-by: Jean Privat <jean@pryen.org>

tool_context: do not need an attribute bash_completion

Signed-off-by: Jean Privat <jean@pryen.org>

tool_context: just print the bash_completion, let the caller do what it want

Signed-off-by: Jean Privat <jean@pryen.org>

tool_context: correct default for bashcompletion

Signed-off-by: Jean Privat <jean@pryen.org>

Merge: Bufferized ropes

Added module to lib for the support of an experimental way of handling ropes using Buffers as leaves.

Will require the merge of PRs #516 and #518 for tests to comply.

Pull-Request: #525
Reviewed-by: Alexandre Terrasa <alexandre@moz-code.org>
Reviewed-by: Jean Privat <jean@pryen.org>

src: use `as_notnullable` in code

Basically replace

~~~
if m isa MNullableType then m = m.mtype
~~~

by

~~~
m = m.as_notnullable
~~~

Signed-off-by: Jean Privat <jean@pryen.org>

model: add `MType::as_notnullable` to remove the `nullable` modifier

Signed-off-by: Jean Privat <jean@pryen.org>

tests: update existing savs (new warning or updates)

Signed-off-by: Jean Privat <jean@pryen.org>

tests: add base_gen_final_bound.nit

Signed-off-by: Jean Privat <jean@pryen.org>

modelize_classes: warn on parameter types bounded on final classes

Signed-off-by: Jean Privat <jean@pryen.org>

model: MParameterType.resolve_for handle the case of primitive bounds

~~~
class G[E: Int]
   # Since Int cannot have sublclasses, E == Int
end
~~~

Signed-off-by: Jean Privat <jean@pryen.org>

typing: generalize warning on useless type tests.

Signed-off-by: Jean Privat <jean@pryen.org>

tests: fix a typing error in some tests

Signed-off-by: Jean Privat <jean@pryen.org>

tool_context: bashcompletion use the basename of sys.program_name

as program_name can be a complex path.

Signed-off-by: Jean Privat <jean@pryen.org>

lib/standard/ropes: Adapted substring iterators to new API.

Signed-off-by: Lucas Bajolet <r4pass@hotmail.com>

lib/bufferized_ropes: Redef to_leaf in concat to work with BufferLeaf

Signed-off-by: Lucas Bajolet <r4pass@hotmail.com>

lib/bufferized_ropes: Added default size of a buffer for rope leaves.

Signed-off-by: Lucas Bajolet <r4pass@hotmail.com>

lib/bufferized_ropes: Added tests for bufferized ropes.

Signed-off-by: Lucas Bajolet <r4pass@hotmail.com>

lib/bufferized_ropes: Adapted substring and insert_at for bufferized ropes.

Signed-off-by: Lucas Bajolet <r4pass@hotmail.com>

lib/bufferized_ropes: Added methods to handle creation of a new node in a Rope.

Signed-off-by: Lucas Bajolet <r4pass@hotmail.com>

lib/bufferized_ropes: Added lazy operations for substring and to_s on FlatBuffer.

Signed-off-by: Lucas Bajolet <r4pass@hotmail.com>

lib/standard/ropes: Added BufferLeaf to constructors.

Signed-off-by: Lucas Bajolet <r4pass@hotmail.com>

lib/bufferized_ropes: Added module bufferized_ropes to lib.

Signed-off-by: Lucas Bajolet <r4pass@hotmail.com>

gitignore: some update

Signed-off-by: Jean Privat <jean@pryen.org>

Merge: lib/standard: assert "/home/../".simplify_path == "/"

Fixes #614

Pull-Request: #615
Reviewed-by: Alexandre Terrasa <alexandre@moz-code.org>
Reviewed-by: Lucas Bajolet <r4pass@hotmail.com>

Merge: Tired of having to remember all the Nit options? Try bash_completion!

This PR enables the option --gen-bash-completion that allow user to generate a bash completion file.

Exemple with `nitdoc`:

    $ nitdoc --gen-bash-completion
    $ sudo ln -s <nitdir>/bin/nitdoc.bash /etc/bash_completion.d/nitdoc
    $ . /etc/bash_completion.d/nitdoc

Then:

    $ nitdoc [TAB][TAB]
    $ file1.nit    file2.nit    file3.nit

    $ nitdoc --[TAB][TAB]
    --bash-toolname         --github-base-sha1      --no-dot                --sharedir
    --custom-brand          --github-gitdir         --only-metamodel        --shareurl
    --custom-footer-text    --github-upstream       --only-parse            --source
    --custom-overview-text  --help                  --path                  --stop-on-first-error
    --custom-title          --ignore-visibility     --piwik-site-id         --verbose
    --dir                   --log                   --piwik-tracker         --version
    --disable-phase         --log-dir               --private               --warn
    --gen-bash-completion   --no-color              --quiet

Signed-off-by: Alexandre Terrasa <alexandre@moz-code.org>

Pull-Request: #575
Reviewed-by: Jean Privat <jean@pryen.org>
Reviewed-by: Lucas Bajolet <r4pass@hotmail.com>
Reviewed-by: Alexis Laferrière <alexis.laf@xymus.net>

Merge: rename Sys::args

A step towards #461 since I do not want to do a mass migration.

Pull-Request: #613
Reviewed-by: Lucas Bajolet <r4pass@hotmail.com>
Reviewed-by: Alexandre Terrasa <alexandre@moz-code.org>

Merge: Opts: small improvement

- syntax & comment
- hide an option
- fix an old bug

This rewrites and closes #531

Pull-Request: #612
Reviewed-by: Frédéric Vachon <fredvac@gmail.com>
Reviewed-by: Alexandre Terrasa <alexandre@moz-code.org>

Merge: Add annotation `fixed` for virtual types

Fixed virtual types prevent redefinition is subclasses

~~~
class A
   type F: Foo is fixed
end
class B
   super A
   redef type F: Foo # Static error
end
~~~

Currently, there is no really apparent benefit of fixed virtual types because the hack of `typing::check_subtype`. Thus this is only a step toward the resolution of #298.

Note: the first commits introduce the basic verification on redefinitons of virtual types that is missing; but nobody saw that there was no checks.

Pull-Request: #611
Reviewed-by: Alexandre Terrasa <alexandre@moz-code.org>

Merge: Introduce `neo`: a model saver/loader from/to neo4j.

The `neo` module can be used to save or load a model from a Neo4j graph database.

Next pull requests will bring tools based on `neo`.

Pull-Request: #606
Reviewed-by: Jean Privat <jean@pryen.org>
Reviewed-by: Lucas Bajolet <r4pass@hotmail.com>

tests: add `test_toolcontext`

Signed-off-by: Alexandre Terrasa <alexandre@moz-code.org>

tests: add `test_neo`

Signed-off-by: Alexandre Terrasa <alexandre@moz-code.org>

tests: introduces `test_prog` a program that build a fake documented model to test model related tools.

Signed-off-by: Alexandre Terrasa <alexandre@moz-code.org>

src: Introduces `neo` a module for save and load Nit models intro a Neo4j graph database.

Signed-off-by: Alexandre Terrasa <alexandre@moz-code.org>

neo4j: add `save_entity` shortcut in NeoBatch.

Signed-off-by: Alexandre Terrasa <alexandre@moz-code.org>

neo4j: add `with_labels` to load node having multiple labels in one Cypher query.

Signed-off-by: Alexandre Terrasa <alexandre@moz-code.org>

lib/standard: assert "/home/../".simplify_path == "/"

Fixes #614

Signed-off-by: Jean Privat <jean@pryen.org>

toolcontext: add `bash_completion` generation option for nit tools.

Signed-off-by: Alexandre Terrasa <alexandre@moz-code.org>

template: add `Template::addn` service

Signed-off-by: Alexandre Terrasa <alexandre@moz-code.org>

toolcontext: provide option `set-dummy-tool` used to fix the `toolname` and `version` services so they return respectively "DUMMY_TOOL" and "DUMMY_VERSION".

Useful for testing.

Signed-off-by: Alexandre Terrasa <alexandre@moz-code.org>

tests: extends test_opts for grouped single options

Signed-off-by: Jean Privat <jean@pryen.org>

tests: add base_virtual_type_fixed.nit

Signed-off-by: Jean Privat <jean@pryen.org>

model: introduce `MVirtualType::is_fixed` used indirectly by is_subtype

Signed-off-by: Jean Privat <jean@pryen.org>

typing: remove hack for top-level method `args`

Signed-off-by: Jean Privat <jean@pryen.org>

lib/standard: distinguish `args` and `sys.args`

The former is now a genuine top-level method.
The latter is now called `sys.program_args`.

Signed-off-by: Jean Privat <jean@pryen.org>

opts: fix crash on grouped single options

Signed-off-by: Jean Privat <jean@pryen.org>

opts: added possibility to hide an option from the usage (easter egg?)

Signed-off-by: Maxime Leroy <maxime.leroy76@gmail.com>

opts: added some obvious comments and fixed some syntax

Signed-off-by: Maxime Leroy <maxime.leroy76@gmail.com>

tests: extends base_virtual_type_redef for `is fixed`

Signed-off-by: Jean Privat <jean@pryen.org>

model: add annotation `fixed` on virtual types

Signed-off-by: Jean Privat <jean@pryen.org>

tests: update for VT check

Signed-off-by: Jean Privat <jean@pryen.org>

Merge: Fix Android app name

Fixes the error reported by @privat

Pull-Request: #610
Reviewed-by: Lucas Bajolet <r4pass@hotmail.com>
Reviewed-by: Jean Privat <jean@pryen.org>

Merge: Serialization: use model to get attribute types & `auto_serializable` implies `super Serializable`

The `auto_serializable` implies `super Serializable` part is up for discussion. It cleans up the code, but the code could no more be compatible with engines that do not handle the annotation.

Next there will be a tool (and/or a phase) to generate support to deserialize generic types.

Pull-Request: #608
Reviewed-by: Lucas Bajolet <r4pass@hotmail.com>
Reviewed-by: Jean Privat <jean@pryen.org>

Merge: mnit_simple : Refactoring of android modules tests

All mnit_simple tests have been refactored to multiple test files allowing to run tests on a module basis. A new folder named `tests` has been created containing these tests. Each test now has a Makefile entry based on that rule : `test_Module_Name`.

Pull-Request: #568
Reviewed-by: Jean Privat <jean@pryen.org>
Reviewed-by: Alexis Laferrière <alexis.laf@xymus.net>

Merge: nitmetrics: fix typo in usage text

Signed-off-by: Alexis Laferrière <alexis.laf@xymus.net>

Pull-Request: #607
Reviewed-by: Jean Privat <jean@pryen.org>

examples: add an app_name to mnit_moles

Signed-off-by: Alexis Laferrière <alexis.laf@xymus.net>

android: fix app_name in res

Signed-off-by: Alexis Laferrière <alexis.laf@xymus.net>

modelize_properties: check redef types in ATypePropdef

Because some programs (mnit) rely on unsound virtual type refinement,
some errors are displayed as warnings.

Signed-off-by: Jean Privat <jean@pryen.org>

test: update serialization tests use of attributes and super class declaration

Signed-off-by: Alexis Laferrière <alexis.laf@xymus.net>

model: silence warnings on multiple declaration of superclasses from artifical code

Signed-off-by: Alexis Laferrière <alexis.laf@xymus.net>

serialization: use a post model phase to set expected attributes type

Signed-off-by: Alexis Laferrière <alexis.laf@xymus.net>

serialization: move type_name to AType and apply recursively

Signed-off-by: Alexis Laferrière <alexis.laf@xymus.net>

serialization: correctly detect generic types

Signed-off-by: Alexis Laferrière <alexis.laf@xymus.net>

serialization: automaticly add Serializable to auto_serializable classes

Signed-off-by: Alexis Laferrière <alexis.laf@xymus.net>

nitmetrics: fix typo in usage text

Signed-off-by: Alexis Laferrière <alexis.laf@xymus.net>

Merge: fix Int#to_s and migrate Java FFI Int to longs

A rewrite that closes #592 and closes #458

Pull-Request: #609
Reviewed-by: Lucas Bajolet <r4pass@hotmail.com>
Reviewed-by: Alexis Laferrière <alexis.laf@xymus.net>