NAME
Perinci::Sub::Gen::AccessTable - Generate function (and its metadata) to
read table data
VERSION
This document describes version 0.593 of Perinci::Sub::Gen::AccessTable
(from Perl distribution Perinci-Sub-Gen-AccessTable), released on
2023-07-09.
SYNOPSIS
In list_countries.pl:
#!perl
use strict;
use warnings;
use Perinci::CmdLine;
use Perinci::Sub::Gen::AccessTable qw(gen_read_table_func);
our %SPEC;
my $countries = [
['cn', 'China', 'Cina', [qw/panda/]],
['id', 'Indonesia', 'Indonesia', [qw/bali tropical/]],
['sg', 'Singapore', 'Singapura', [qw/tropical/]],
['us', 'United States of America', 'Amerika Serikat', [qw//]],
];
my $res = gen_read_table_func(
name => 'list_countries',
summary => 'func summary', # opt
description => 'func description', # opt
table_data => $countries,
table_def => {
summary => 'List of countries',
fields => {
id => {
schema => 'str*',
summary => 'ISO 2-letter code for the country',
pos => 0,
sortable => 1,
},
eng_name => {
schema => 'str*',
summary => 'English name',
pos => 1,
sortable => 1,
},
ind_name => {
schema => 'str*',
summary => 'Indonesian name',
pos => 2,
sortable => 1,
},
tags => {
schema => 'array*',
summary => 'Keywords/tags',
pos => 3,
sortable => 0,
},
},
pk => 'id',
},
);
die "Can't generate function: $res->[0] - $res->[1]" unless $res->[0] == 200;
Perinci::CmdLine->new(url=>'/main/list_countries')->run;
Now you can do:
# list all countries, by default only PK field is shown
$ list_countries.pl --format=text-simple
cn
id
sg
us
# show as json, randomize order
$ list_countries.pl --format=json --random
["id","us","sg","cn"]
# only list countries which are tagged as 'tropical', sort by ind_name field in
# descending order, show all fields (--detail)
$ list_countries.pl --detail --sort -ind_name --tags-has '[tropical]'
.---------------------------------------------.
| eng_name | id | ind_name | tags |
+-----------+----+-----------+----------------+
| Singapore | sg | Singapura | tropical |
| Indonesia | id | Indonesia | bali, tropical |
'-----------+----+-----------+----------------'
# show only certain fields, limit number of records, return in YAML format
$ list_countries.pl --fields '[id, eng_name]' --result-limit 2 --format=yaml
- 200
- OK
-
- id: cn
eng_name: China
- id: id
eng_name: Indonesia
DESCRIPTION
This module is useful when you want to expose a table data (an array of
hashrefs, an array of arrays, or external data like a SQL table) as an
API function. This module will generate a function (along with its Rinci
metadata) that accepts arguments for specifying fields, filtering,
sorting, and paging. The resulting function can then be run via
command-line using Perinci::CmdLine (as demonstrated in Synopsis), or
served via HTTP using Perinci::Access::HTTP::Server, or consumed
normally by Perl programs.
FUNCTIONS
gen_read_table_func
Usage:
gen_read_table_func(%args) -> [$status_code, $reason, $payload, \%result_meta]
Generate function (and its metadata) to read table data.
The generated function acts like a simple single table SQL SELECT query,
featuring filtering, ordering, and paging, but using arguments as the
'query language'. The generated function is suitable for exposing a
table data from an API function.
The resulting function returns an array of results/records and accepts
these arguments.
* *with_field_names* => BOOL (default 1)
If set to 1, function will return records of field values along with
field names (hashref), e.g. {id=>'ID', country=>'Indonesia',
capital=>'Jakarta'}. If set to 0, then function will return record
containing field values without field names (arrayref) instead,
e.g.: ['ID', 'Indonesia', 'Jakarta'].
* *detail* => BOOL (default 0)
This is a field selection option. If set to 0, function will return
PK field only. If this argument is set to 1, then all fields will be
returned (see also *fields* to instruct function to return some
fields only).
* *fields* => ARRAY
This is a field selection option. If you only want certain fields,
specify them here (see also *detail*).
* *result_limit* => INT (default undef)
* *result_start* => INT (default 1)
The *result_limit* and *result_start* arguments are paging options,
they work like LIMIT clause in SQL, except that index starts at 1
and not 0. For example, to return the first 20 records in the
result, set *result_limit* to 20 . To return the next 20 records,
set *result_limit* to 20 and *result_start* to 21.
* *random* => BOOL (default 0)
The random argument is an ordering option. If set to true, order of
records returned will be shuffled first. This happened before
paging.
* *sort* => array of str
The sort argument is an ordering option, containing names of field.
A "-" prefix before the field name signifies descending instead of
ascending order. Multiple fields are allowed for secondary sort
fields.
* *q* => ARRAY[STR]
A filtering option. By default, all fields except those specified
with searchable=0 will be searched using simple case-insensitive
string search. There are a few options to customize this, using
these gen arguments: *word_search*, *case_insensitive_search*,
*custom_search*, *default_query_boolean*.
* *query_boolean* => STR
Either "and" or "or". Default can be set with gen argument
*default_query_boolean*. With "and", all the words in *q* argument
must match. With "or", only one of the words in *q* argument must
match.
* Filter arguments
They will be generated for each field, except when field has
'filterable' clause set to false.
Undef values will not match any filter, just like NULL in SQL.
* *FIELD.is* and *FIELD.isnt* arguments for each field. Only
records with field equalling (or not equalling) value exactly
('==' or 'eq') will be included. If doesn't clash with other
function arguments, *FIELD* will also be added as an alias for
*FIELD.is*.
* *FIELD.has* and *FIELD.lacks* array arguments for each set
field. Only records with field having or lacking certain value
will be included.
* *FIELD.min* and *FIELD.max* for each int/float/str field. Only
records with field greater/equal than, or less/equal than a
certain value will be included.
* *FIELD.contains* and *FIELD.not_contains* for each str field.
Only records with field containing (or not containing) certain
value (substring) will be included.
* *FIELD.matches* and *FIELD.not_matches* for each str field. Only
records with field matching (or not matching) certain value
(regex) (or will be included. Function will return 400 if regex
is invalid. These arguments will not be generated if
'filterable_regex' clause in field specification is set to 0.
This function is not exported by default, but exportable.
Arguments ('*' denotes required arguments):
* case_insensitive_comparison => *bool* (default: 1)
Decide whether generated function will perform case-insensitive
comparison (e.g. for FIELD.is).
* case_insensitive_search => *bool* (default: 1)
Decide whether generated function will perform case-insensitive
search.
* custom_filters => *hash*
Supply custom filters.
A hash of filter name and definitions. Filter name will be used as
generated function's argument and must not clash with other
arguments. Filter definition is a hash containing these keys: *meta*
(hash, argument metadata), *code*, *fields* (array, list of table
fields related to this field).
Code will be called for each record to be filtered and will be
supplied ($r, $v, $opts) where $v is the filter value (from the
function argument) and $r the hashref record value. $opts is
currently empty. Code should return true if record satisfies the
filter.
* custom_search => *code*
Supply custom searching for generated function.
Code will be supplied ($r, $q, $opts) where $r is the record
(hashref), $q is the search term (from the function argument 'q'),
and $opts is {ci=>0|1}. Code should return true if record matches
search term.
* default_arg_values => *hash*
Specify defaults for generated function's arguments.
Can be used to supply default filters, e.g.
# limit years for credit card expiration date
{ "year.min" => $curyear, "year.max" => $curyear+10, }
* default_detail => *bool*
Supply default 'detail' value for function arg spec.
* default_exclude_fields => *str*
Supply default 'exclude_fields' value for function arg spec.
* default_fields => *str*
Supply default 'fields' value for function arg spec.
* default_query_boolean => *str* (default: "and")
Specify default for --query-boolean option.
* default_random => *bool*
Supply default 'random' value in generated function's metadata.
* default_result_limit => *int*
Supply default 'result_limit' value in generated function's
metadata.
* default_sort => *array[str]*
Supply default 'sort' value in generated function's metadata.
* default_with_field_names => *bool*
Supply default 'with_field_names' value in generated function's
metadata.
* description => *str*
Generated function's description.
* detail_aliases => *hash*
(No description)
* enable_field_selection => *bool* (default: 1)
Decide whether generated function will support field selection (the
`fields` argument).
* enable_filtering => *bool* (default: 1)
Decide whether generated function will support filtering (the FIELD,
FIELD.is, FIELD.min, etc arguments).
* enable_ordering => *bool* (default: 1)
Decide whether generated function will support ordering (the `sort`
& `random` arguments).
* enable_paging => *bool* (default: 1)
Decide whether generated function will support paging (the
`result_limit` & `result_start` arguments).
* enable_random_ordering => *bool* (default: 1)
Decide whether generated function will support random ordering (the
`random` argument).
Ordering must also be enabled ("enable_ordering").
* enable_search => *bool* (default: 1)
Decide whether generated function will support searching (argument
q).
Filtering must also be enabled ("enable_filtering").
* exclude_fields_aliases => *hash*
(No description)
* extra_args => *hash*
Extra arguments for the generated function.
* extra_props => *hash*
Extra metadata properties for the generated function metadata.
* fields_aliases => *hash*
(No description)
* hooks => *hash*
Supply hooks.
You can instruct the generated function to execute codes in various
stages by using hooks. Currently available hooks are:
"before_parse_query", "after_parse_query", "before_fetch_data",
"after_fetch_data", "before_return". Hooks will be passed the
function arguments as well as one or more additional ones. All hooks
will get "_stage" (name of stage) and "_func_res" (function
arguments, but as hash reference so you can modify it).
"after_parse_query" and later hooks will also get "_parse_res"
(parse result). "before_fetch_data" and later will also get
"_query". "after_fetch_data" and later will also get "_data".
"before_return" will also get "_func_res" (the enveloped response to
be returned to user).
Hook should return nothing or a false value on success. It can abort
execution of the generated function if it returns an envelope
response (an array). On that case, the function will return with
this return value.
* install => *bool* (default: 1)
Whether to install generated function (and metadata).
By default, generated function will be installed to the specified
(or caller's) package, as well as its generated metadata into %SPEC.
Set this argument to false to skip installing.
* langs => *array[str]* (default: ["en_US"])
Choose language for function metadata.
This function can generate metadata containing text from one or more
languages. For example if you set 'langs' to ['en_US', 'id_ID'] then
the generated function metadata might look something like this:
{
v => 1.1,
args => {
random => {
summary => 'Random order of results', # English
"summary.alt.lang.id_ID" => "Acak urutan hasil", # Indonesian
...
},
...
},
...
}
* name => *str*
Generated function's name, e.g. `myfunc`.
* package => *str*
Generated function's package, e.g. `My::Package`.
This is needed mostly for installing the function. You usually don't
need to supply this if you set "install" to false.
If not specified, caller's package will be used by default.
* queries_aliases => *hash*
(No description)
* random_aliases => *hash*
(No description)
* result_limit_aliases => *hash*
(No description)
* result_start_aliases => *hash*
(No description)
* sort_aliases => *hash*
(No description)
* summary => *str*
Generated function's summary.
* table_data* => *array|code|obj*
Data.
Table data is either an AoH/AoA, or a TableData object, or a
coderef.
Passing a subroutine lets you fetch data dynamically and from
arbitrary source (e.g. DBI table or other external sources). The
subroutine will be called with these arguments ('$query') and is
expected to return a hashref like this {data => DATA, paged=>BOOL,
filtered=>BOOL, sorted=>BOOL, fields_selected=>BOOL}. DATA is AoA or
AoH. If paged is set to 1, data is assumed to be already paged and
won't be paged again; likewise for filtered, sorted, and fields
selected. These are useful for example with DBI result, where
requested data is already filtered/sorted (including
randomized)/field selected/paged via appropriate SQL query. This
way, the generated function will not attempt to duplicate the
efforts.
'$query' is a hashref which contains information about the query,
e.g. 'args' (the original arguments passed to the generated
function, e.g. {random=>1, result_limit=>1, field1_match=>'f.+'}),
'mentioned_fields' which lists fields that are mentioned in either
filtering arguments or fields or ordering, 'requested_fields'
(fields mentioned in list of fields to be returned), 'sort_fields'
(fields mentioned in sort arguments), 'filter_fields' (fields
mentioned in filter arguments).
* table_def => *hash*
Table definition.
Required, unless "table_data" argument is a TableData object, in
which case table definition will be retrieved from the object if not
supplied.
See TableDef for more details.
A hashref with these required keys: 'fields', 'pk'. 'fields' is a
hashref of field specification with field name as keys, while 'pk'
specifies which field is to be designated as the primary key.
Currently only single-field PK is allowed.
Field specification. A hashref with these required keys: 'schema' (a
Sah schema), 'index' (an integer starting from 0 that specifies
position of field in the record, required with AoA data) and these
optional clauses: 'sortable' (a boolean stating whether field can be
sorted, default is true), 'filterable' (a boolean stating whether
field can be mentioned in filter options, default is true).
* with_field_names_aliases => *hash*
(No description)
* word_search => *bool* (default: 0)
Decide whether generated function will perform word searching
instead of string searching.
For example, if search term is 'pine' and field value is 'green
pineapple', search will match if word_search=false, but won't match
under word_search.
This will not have effect under 'custom_search'.
Returns an enveloped result (an array).
First element ($status_code) is an integer containing HTTP-like status
code (200 means OK, 4xx caller error, 5xx function error). Second
element ($reason) is a string containing error message, or something
like "OK" if status is 200. Third element ($payload) is the actual
result, but usually not present when enveloped result is an error
response ($status_code is not 2xx). Fourth element (%result_meta) is
called result metadata and is optional, a hash that contains extra
information, much like how HTTP response headers provide additional
metadata.
Return value: A hash containing generated function, metadata (hash)
FAQ
I want my function to accept additional arguments.
You can use the "extra_args" argument:
gen_read_table_func(
name => 'myfunc',
extra_args => {
foo => {schema=>'int*'},
bar => {summary => 'Yet another arg for myfunc', schema=>'str*'},
},
);
As for the implementation, you can specify hooks to do things with the
extra arguments.
HOMEPAGE
Please visit the project's homepage at
<https://metacpan.org/release/Perinci-Sub-Gen-AccessTable>.
SOURCE
Source repository is at
<https://github.com/perlancar/perl-Perinci-Sub-Gen-AccessTable>.
SEE ALSO
Perinci::Sub::Gen::AccessTable::Simple for a simpler variant.
Rinci
Perinci::CmdLine
AUTHOR
perlancar <perlancar@cpan.org>
CONTRIBUTOR
Steven Haryanto <stevenharyanto@gmail.com>
CONTRIBUTING
To contribute, you can send patches by email/via RT, or send pull
requests on GitHub.
Most of the time, you don't need to build the distribution yourself. You
can simply modify the code, then test via:
% prove -l
If you want to build the distribution (e.g. to try to install it locally
on your system), you can install Dist::Zilla,
Dist::Zilla::PluginBundle::Author::PERLANCAR,
Pod::Weaver::PluginBundle::Author::PERLANCAR, and sometimes one or two
other Dist::Zilla- and/or Pod::Weaver plugins. Any additional steps
required beyond that are considered a bug and can be reported to me.
COPYRIGHT AND LICENSE
This software is copyright (c) 2023, 2022, 2020, 2019, 2018, 2017, 2016,
2015, 2014, 2013, 2012, 2011 by perlancar <perlancar@cpan.org>.
This is free software; you can redistribute it and/or modify it under
the same terms as the Perl 5 programming language system itself.
BUGS
Please report any bugs or feature requests on the bugtracker website
<https://rt.cpan.org/Public/Dist/Display.html?Name=Perinci-Sub-Gen-Acces
sTable>
When submitting a bug or request, please include a test-file or a patch
to an existing test-file that illustrates the bug or desired feature.
CAVEATS
It is often not a good idea to expose your database schema directly as
API.