aboutsummaryrefslogtreecommitdiffstats
path: root/bitbake
AgeCommit message (Collapse)Author
2010-10-22bitbake/fetch: When fetchers return errors, ensure any partial download is ↵Richard Purdie
cleared Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-10-22bitbake/fetch: Make URL checking slightly less verbose (distracting with the ↵Richard Purdie
sstate code) Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-10-22pseudo/fakeroot: Move the pseudo directory creation into bitbakeRichard Purdie
If sstate was used to accelerate a build, the pseudo directory might not have been created leading to subsequent task failures. Also, sstate packages were not being installed under pseudo context meaning file permissions could have been lost. Fix these problems by creating a FAKEROOTDIRS variable which bitbake ensures exists before running tasks and running the appropriate setscene tasks under fakeroot context. Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-10-20bitbake/fetch/git: Ensure fullclone repositories are fully fetchedRichard Purdie
The git fetcher was failing to pull in new branches into a git repository mirror tarball as the git fetch command being used didn't add new remote branches. This patch uses "git fetch --all" for fullclones to ensure any new remote branches are cloned correctly. Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-10-20bitbake/fetcher: Deal with a ton of different bugsRichard Purdie
The more we try and patch up the fetcher code, the more things break. The code blocks in question are practically unreadable and are full of corner cases where fetching could fail. In summary the issues noticed included: a) Always fetching strange broken urls from the premirror for "noclone" git repositories b) Not creating or rewriting .md5 stamp files inconsistently c) Always fetching git source mirror tarballs from the premirror even if they already exist but the checkout directory does now d) Passing "None" values to os.access() and os.path.extsts() checks under certain circumstances e) Not using fetched git mirror tarballs if the preexist and always try and fetch them. This patch rewrites the sections of code in question to be simpler and more readable, fixing the above problems and most likely other odd corner cases. Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-10-20bitbake/fetch/git.py: Fix git fetcher to correctly use mirror tarballsRichard Purdie
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-10-14bitbake-runtask: Ensure logging settings take effect in the worker process ↵Richard Purdie
(and pass verbose setting) Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-10-12bitbake/runqueue: make the runtask program configurableJoshua Lock
Signed-off-by: Joshua Lock <josh@linux.intel.com>
2010-10-11bitbake/build.py: Write logfiles on a per task basis, not per functionRichard Purdie
Per function logging made it hard to track down what was happening so switch to logging on a per task basis. [BUGID #383] Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-10-11bitbake-runtask: Ensure logging options are inherited from the parentRichard Purdie
[BUGID #291] Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-10-09bitbake/fetch: Ensure SRCREV is still set correctly if the pn-X override has ↵Richard Purdie
been expanded Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-10-07bitbake/runqueue.py: Fix invalid variable reference fixing the -f option ↵Richard Purdie
with setscene tasks Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-10-07bitbake/fetch/__init__.py: Abstract mirror variable handling and enhance to ↵Richard Purdie
accept \n delimitation in variables Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-10-07Export ALL_PROXY for bitbake commandsDarren Hart
We already export http,ftp,https proxy environment variables. Some environments, GNOME for instance, place the socks proxy in ALL_PROXY and all_proxy. Export it as well. Signed-off-by: Darren Hart <dvhart@linux.intel.com>
2010-10-05bitbake/sstate: Implement a lookup function to speed up setscene processingRichard Purdie
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-10-05bitbake/fetch: if mirror fetching fails, ensure exception is raisedJoshua Lock
We catch any exception raised by the fetchers go() method and attempt to work around it by trying any (post) mirrors which are configured. However, should the mirrors fail the exception is lost and the fetch is assumed to have completed successfully. Instead, save the exception and if the local file does not exist after trying the mirrors re-raise the exception. Fixes [BUGID #362] Signed-off-by: Joshua Lock <josh@linux.intel.com>
2010-10-01build.py: Add a symlink for the loggingMark Hatle
[BUGID #375] When configuring for the log file output, we generate a symlink to the target filename. This link uses the same file naming, but without the active pid, making it easier to see which log file is the last one generated. Signed-off-by: Mark Hatle <mark.hatle@windriver.com>
2010-09-30bitbake/bitbake-sigdiff: Extend to handle dumping single state siginfo filesRichard Purdie
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-09-30bitbake/siggen: Fix issue where excluded dependencies caused exceptionsRichard Purdie
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-09-29bitbake/bitbake-runtask: Signatures are needed in task context and have ↵Richard Purdie
little overhead so enable in worker context Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-09-29bitbake/siggen: Ensure full signature data is not held unless needed, ↵Richard Purdie
reducing memory consumption Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-09-28bitbake: Pass task hash information to subprocessesRichard Purdie
Pass task has informaiton to work processes, allowing full manipulation of the hash data in the task context allowing checksums to be usable. Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-09-28bitbake/fetch: fix logic to prevent fetches when the file already existsJoshua Lock
Signed-off-by: Joshua Lock <josh@linux.intel.com>
2010-09-28codeparser.py: Fix storing of hash values as object references can be corruptedRichard Purdie
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-09-13bitbake/runqueue: Remove now unneeded indentationRichard Purdie
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-09-13bitbake/runqueue.py: Optimise delay values to avoid unneeded delaysRichard Purdie
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-09-13bitbake/siggen: Allow generation of siggen data from task contextRichard Purdie
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-09-13bitbake/build.py: Set BB_FILENAME to represent the .bb file being built ↵Richard Purdie
(including any virtual prefix) Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-09-13bitbake/siggen.py: Improve debugging of checksumsRichard Purdie
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-09-13bitbake/data.py: Allow variables to suplement dependencies using the vardep flagRichard Purdie
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-09-10bitbake/fetch: ensure the go() method completes when not using premirrorsJoshua Lock
Signed-off-by: Joshua Lock <josh@linux.intel.com>
2010-09-10bitbake: Add proxy variables to standard export listZhai Edwin
With "no_proxy" exported to bitbake, both internal and externel file mirror can be used. "https_proxy" enable fetching "https://" file through proxy. Signed-off-by: Zhai Edwin <edwin.zhai@intel.com>
2010-09-09bitbake/__init__.py: Fix named SRCREVS variable name ordering with backwards ↵Richard Purdie
compatibility Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-09-08bitbake: save the initial PATH for use when starting a subprocessJoshua Lock
It was possible for bitbake-runtime to be run against a semi-installed python-native resulting in tracebacks with ImportError's. To prevent this we stash the initial PATH in the BBConfiguration when bitbake is started and then set this in the env when launching bitbake-runtask through subprocesses Popen() call. Signed-off-by: Joshua Lock <josh@linux.intel.com>
2010-09-08bitbake/fetch/git: fix try_premirror() definition .Method takes 4 parameters.Joshua Lock
Signed-off-by: Joshua Lock <josh@linux.intel.com>
2010-09-08bitbake/fetch: fix by moving try_premirror() to the right placeJoshua Lock
The previous commit didn't define the method as part of the Fetch object Signed-off-by: Joshua Lock <josh@linux.intel.com>
2010-09-08bitbake/fetch: add try_premirror method and special case git fetcherJoshua Lock
Add a new method, try_premirror, to the Fetch object which checks to see whether the file needs to be fetched from a premirror. Override this in the Git fetcher to only require a pre-mirror fetch when the clone directory does not exist. Fixes [BUGID 290] Signed-off-by: Joshua Lock <josh@linux.intel.com>
2010-09-07bitbake/bitbake-runtask: Ensure signals to the parent don't pass to the ↵Richard Purdie
children directly Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-09-07bitbake/codeparser: Deal with functions with trailing whitespaceRichard Purdie
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-09-06fetch: fix setting of localpath in SRC_URI parametersJoshua Lock
When setting localpath in the SRC_URI parameters the basename should be set explicitly as the localpath() method is not called. Fixes [BUGID #81] Signed-off-by: Joshua Lock <josh@linux.intel.com>
2010-09-03bitbake: Add missing signature filesRichard Purdie
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-09-03bitbake: Implement signaturesRichard Purdie
Includes functionality to find out what changes between two different singature data dumps. Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-09-03bitbake/codeparser: Ensure cached sheel entries return the correct dependenciesRichard Purdie
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-09-03bitbake/ast: Ensure function definitions are always added to the dictonaryRichard Purdie
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-09-01bitbake/fetch: ensure the mirrored repository is updated as requiredJoshua Lock
If we fetch a tarball from a mirror it's entirely possible that the mirror will have been from before the required tag/branch/etc was included in the repository. To that end use forcefetch() as a way of testing whether the repository is up to date and if not fetch updates. Signed-off-by: Joshua Lock <josh@linux.intel.com>
2010-09-01bitbake/git: define a forcefetch methodJoshua Lock
The git fetcher should force a fetch if the required tag is not present in the local clone, or if the fullclone parameter is set. Signed-off-by: Joshua Lock <josh@linux.intel.com>
2010-09-01bitbake/fetch: Respect forcefetch even when pulling from a mirrorJoshua Lock
When pulling from a premirror we would prefer a local tarball even when the caller had specified the forcefetch parameter. Add an extra parameter 'force' to try_mirrors, defaulting to False. If set the mirrors will be tested even if the file exists locally. Signed-off-by: Joshua Lock <josh@linux.intel.com>
2010-08-31bitbake/codeparser: Implement persistent cacheRichard Purdie
For a given input to this code, the output doesn't change to implement a persistent cache of the data to speed up parsing. Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-08-31bitbake/data.py: Add emit_func() and generate_dependencies() functionsRichard Purdie
These functions allow generation of dependency data between funcitons and variables allowing moves to be made towards generating checksums and allowing use of the dependency information in other parts of bitbake. Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-08-31bitbake: Add codeparser for parsing shell and python functionsRichard Purdie
This commit is derived from Chris Larson's checksum work, turned into a standalone piece of code for parsing python and shell functions. The deindent code has been replaced with code to work around indentation for speed. The original NodeVisitor in the ast was replaced with a faster class walk call. Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>