Class: DataJunk documentation

datajunk~DataJunk()

Wow so much methods !

Constructor

new DataJunk()

Source:

Members

colors

colors options import

Source:

eatd

eatdiner import

Source:

fs

Fs dep import for writing feeds

Source:

https

http module import for sources requests

Source:

MOQREQUEST

reqmodels models import

Source:

Methods

begdata(where, callback)

Parameters:
Name Type Description
where Object

Object containing all source infos and parsing methods

callback function

to get the result

Source:

dbthis(s, callback) → {function}

Parameters:
Name Type Description
s Object

the datas to be inserted

Properties
Name Type Description
id String

the source name

url String

the source url

d String

the source 'd'atas

callback function

the callback function to get responses

Source:
To Do:
  • To be refactored with Mongoose Models
Returns:

callback

Type
function

eat(dset) → {Object}

Operations Pour tout les elements dans parseme (obj: )

Parameters:
Name Type Description
dset Object

results from feeds array in db

Source:
Returns:

res parsed and colored data feed

Type
Object

flags(col, dt, res, ts)

Parsing helper function 1 - Tag subject from title 2 - Tag bull type from description || title 3 - Tag bear type from description || title 4 - Return res and updates counters

Parameters:
Name Type Description
col Object
dt Object
res Object
ts Object
Source:

getfiles(datadir) → {function}

Put .json file in directory and format them to feed db according to #models~data schemas

Parameters:
Name Type Description
datadir String

the json datas directory

Source:
Returns:

Promise resolve reject nothing fancy

Type
function

goshopping(where) → {Promise}

DataJunk#begdata, then DataJunk#wr and finally return promise

Parameters:
Name Type Description
where Object

see module:models~RequestSchemas

Source:
Returns:
Type
Promise

logeat()

Dummy helper for logging progress

Source:

wr(fn, d) → {Promise}

Wr aka write file, write gathered json inside DTAFOOD directory

Parameters:
Name Type Description
fn string

file name

d Object

data to write json fmt

Source:
Returns:

d corresponding to writed data

Type
Promise