Go to file
Bjørn Erik Pedersen c6d650c8c8
tpl/tplimpl: Rework template management to get rid of concurrency issues
This more or less completes the simplification of the template handling code in Hugo started in v0.62.

The main motivation was to fix a long lasting issue about a crash in HTML content files  without front matter.

But this commit also comes with a big functional improvement.

As we now have moved the base template evaluation to the build stage we now use the same lookup rules for `baseof` as for `list` etc. type of templates.

This means that in this simple example you can have a `baseof` template for the `blog` section without having to duplicate the others:

```
layouts
├── _default
│   ├── baseof.html
│   ├── list.html
│   └── single.html
└── blog
    └── baseof.html
```

Also, when simplifying code, you often get rid of some double work, as shown in the "site building" benchmarks below.

These benchmarks looks suspiciously good, but I have repeated the below with ca. the same result. Compared to master:

```
name                              old time/op    new time/op    delta
SiteNew/Bundle_with_image-16        13.1ms ± 1%    10.5ms ± 1%  -19.34%  (p=0.029 n=4+4)
SiteNew/Bundle_with_JSON_file-16    13.0ms ± 0%    10.7ms ± 1%  -18.05%  (p=0.029 n=4+4)
SiteNew/Tags_and_categories-16      46.4ms ± 2%    43.1ms ± 1%   -7.15%  (p=0.029 n=4+4)
SiteNew/Canonify_URLs-16            52.2ms ± 2%    47.8ms ± 1%   -8.30%  (p=0.029 n=4+4)
SiteNew/Deep_content_tree-16        77.9ms ± 1%    70.9ms ± 1%   -9.01%  (p=0.029 n=4+4)
SiteNew/Many_HTML_templates-16      43.0ms ± 0%    37.2ms ± 1%  -13.54%  (p=0.029 n=4+4)
SiteNew/Page_collections-16         58.2ms ± 1%    52.4ms ± 1%   -9.95%  (p=0.029 n=4+4)

name                              old alloc/op   new alloc/op   delta
SiteNew/Bundle_with_image-16        3.81MB ± 0%    2.22MB ± 0%  -41.70%  (p=0.029 n=4+4)
SiteNew/Bundle_with_JSON_file-16    3.60MB ± 0%    2.01MB ± 0%  -44.20%  (p=0.029 n=4+4)
SiteNew/Tags_and_categories-16      19.3MB ± 1%    14.1MB ± 0%  -26.91%  (p=0.029 n=4+4)
SiteNew/Canonify_URLs-16            70.7MB ± 0%    69.0MB ± 0%   -2.40%  (p=0.029 n=4+4)
SiteNew/Deep_content_tree-16        37.1MB ± 0%    31.2MB ± 0%  -15.94%  (p=0.029 n=4+4)
SiteNew/Many_HTML_templates-16      17.6MB ± 0%    10.6MB ± 0%  -39.92%  (p=0.029 n=4+4)
SiteNew/Page_collections-16         25.9MB ± 0%    21.2MB ± 0%  -17.99%  (p=0.029 n=4+4)

name                              old allocs/op  new allocs/op  delta
SiteNew/Bundle_with_image-16         52.3k ± 0%     26.1k ± 0%  -50.18%  (p=0.029 n=4+4)
SiteNew/Bundle_with_JSON_file-16     52.3k ± 0%     26.1k ± 0%  -50.16%  (p=0.029 n=4+4)
SiteNew/Tags_and_categories-16        336k ± 1%      269k ± 0%  -19.90%  (p=0.029 n=4+4)
SiteNew/Canonify_URLs-16              422k ± 0%      395k ± 0%   -6.43%  (p=0.029 n=4+4)
SiteNew/Deep_content_tree-16          401k ± 0%      313k ± 0%  -21.79%  (p=0.029 n=4+4)
SiteNew/Many_HTML_templates-16        247k ± 0%      143k ± 0%  -42.17%  (p=0.029 n=4+4)
SiteNew/Page_collections-16           282k ± 0%      207k ± 0%  -26.55%  (p=0.029 n=4+4)
```

Fixes #6716
Fixes #6760
Fixes #6768
Fixes #6778
2020-01-22 09:39:49 +01:00
.circleci Update to Go 1.13.4 and Go 1.12.13 2019-11-25 18:59:06 +01:00
.github Squashed 'docs/' changes from 54f0e8776..bd0e15bb6 2020-01-05 11:13:09 +01:00
bufferpool tests: Convert from testify to quicktest 2019-08-12 13:26:32 +02:00
cache resources/images: Make the image cache more robust 2019-11-25 18:59:06 +01:00
codegen tests: Convert from testify to quicktest 2019-08-12 13:26:32 +02:00
commands tpl/tplimpl: Rework template management to get rid of concurrency issues 2020-01-22 09:39:49 +01:00
common tpl/tplimpl: Rework template management to get rid of concurrency issues 2020-01-22 09:39:49 +01:00
compare tests: Convert from testify to quicktest 2019-08-12 13:26:32 +02:00
config Squashed 'docs/' changes from 51c4f3184..af4b7ac5b 2019-12-15 10:35:09 +01:00
create tpl/tplimpl: Rework template management to get rid of concurrency issues 2020-01-22 09:39:49 +01:00
deploy deploy: Add ability to invalidate Google Cloud CDN 2019-10-03 16:53:45 +02:00
deps tpl/tplimpl: Rework template management to get rid of concurrency issues 2020-01-22 09:39:49 +01:00
docs releaser: Add release notes to /docs for release of 0.62.2 2020-01-05 18:50:35 +00:00
docshelper Add some missing doc comments 2017-08-03 15:57:51 +02:00
examples examples: Fix blog not building 2020-01-19 14:42:27 +01:00
helpers markup/goldmark: Make auto IDs GitHub compatible 2020-01-04 19:46:01 +01:00
htesting Image resource refactor 2019-08-26 15:00:44 +02:00
hugofs Support files in content mounts 2020-01-01 18:19:49 +01:00
hugolib tpl/tplimpl: Rework template management to get rid of concurrency issues 2020-01-22 09:39:49 +01:00
identity Add render template hooks for links and images 2019-12-18 11:44:40 +01:00
langs Rework template handling for function and map lookups 2019-12-12 10:04:35 +01:00
lazy resources/images: Make the image cache more robust 2019-11-25 18:59:06 +01:00
livereload Fix livereload for @import case 2019-07-22 13:54:24 +02:00
markup deps: Update Goldmark to v1.1.21 2020-01-15 12:07:25 +01:00
media Fix incorrect MIME type from image/jpg to image/jpeg 2019-12-19 18:02:11 +01:00
metrics tests: Convert from testify to quicktest 2019-08-12 13:26:32 +02:00
minifiers minifiers: Update to new CSS config 2020-01-07 18:06:22 +01:00
modules Fix abs path handling in module mounts 2019-12-19 18:51:59 +01:00
navigation Fix Params case handling in the index, sort and where func 2019-11-22 18:41:50 +01:00
output tpl/tplimpl: Rework template management to get rid of concurrency issues 2020-01-22 09:39:49 +01:00
parser Add support for newline characters in raw string shortcode 2020-01-18 11:24:10 +01:00
publisher Make Page an interface 2019-03-23 18:51:22 +01:00
related tests: Convert from testify to quicktest 2019-08-12 13:26:32 +02:00
releaser Update releasenotes_writer.go 2020-01-07 13:15:22 +01:00
resources tpl/tplimpl: Rework template management to get rid of concurrency issues 2020-01-22 09:39:49 +01:00
scripts/fork_go_templates tpl: Get rid of the custom template truth logic 2019-12-18 20:05:22 +01:00
snap releaser: Prepare repository for 0.63.0-DEV 2020-01-05 18:58:55 +00:00
source source: Remove debug check left during development 2019-08-23 07:37:56 +02:00
tpl tpl/tplimpl: Rework template management to get rid of concurrency issues 2020-01-22 09:39:49 +01:00
transform tests: Convert from testify to quicktest 2019-08-12 13:26:32 +02:00
watcher Add some missing doc comments 2017-08-03 15:57:51 +02:00
.dockerignore Support Docker args TAGS, WORKDIR, CGO; speed up repetitive builds 2019-02-22 11:53:17 -08:00
.gitattributes .gitattributes: Exclude *.svg from CRLF/LF conversion 2018-07-09 21:06:15 -06:00
.gitignore Create lightweight forks of text/template and html/template 2019-12-12 09:59:34 +01:00
.gitmodules Remove the theme submodule from /docs 2017-08-10 14:54:19 +02:00
.mailmap Add .mailmap to get a more correct author log 2015-01-28 16:50:36 +01:00
.travis.yml Update to Go 1.13.4 and Go 1.12.13 2019-11-25 18:59:06 +01:00
CONTRIBUTING.md Enhance accessibility to issues 2019-12-14 18:47:23 +01:00
Dockerfile Update alpine base image in Dockerfile to 3.11 2019-12-30 13:56:58 +01:00
LICENSE Add a GitHub compatible Apache 2 license text 2018-04-16 00:03:30 +02:00
README.md Squashed 'docs/' changes from 51c4f3184..af4b7ac5b 2019-12-15 10:35:09 +01:00
bench.sh Add GOEXE to support building with different versions of `go` 2017-07-16 00:35:15 +02:00
benchSite.sh Run benchmarks 3 times 2018-01-14 00:49:01 +01:00
benchbep.sh Add Hugo Modules 2019-07-24 09:35:53 +02:00
bepdock.sh build: Update the temp docker script 2018-09-24 12:41:12 +02:00
go.mod tpl/tplimpl: Rework template management to get rid of concurrency issues 2020-01-22 09:39:49 +01:00
go.sum tpl/tplimpl: Rework template management to get rid of concurrency issues 2020-01-22 09:39:49 +01:00
goreleaser.yml releaser: Update Go Releaser and consolidate the 2 configs 2019-06-11 00:02:06 +02:00
magefile.go Create lightweight forks of text/template and html/template 2019-12-12 09:59:34 +01:00
main.go Add HUGO_NUMWORKERMULTIPLIER 2019-04-05 10:21:25 +02:00
pull-docs.sh Allow the pull-docs script to pull other than master 2017-09-23 10:13:40 +02:00
requirements.txt Squashed 'docs/' changes from 51c4f3184..af4b7ac5b 2019-12-15 10:35:09 +01:00

README.md

Hugo

A Fast and Flexible Static Site Generator built with love by bep, spf13 and friends in Go.

Website | Forum | Documentation | Installation Guide | Contribution Guide | Twitter

GoDoc Linux and macOS Build Status Go Report Card

Overview

Hugo is a static HTML and CSS website generator written in Go. It is optimized for speed, ease of use, and configurability. Hugo takes a directory with content and templates and renders them into a full HTML website.

Hugo relies on Markdown files with front matter for metadata, and you can run Hugo from any directory. This works well for shared hosts and other systems where you dont have a privileged account.

Hugo renders a typical website of moderate size in a fraction of a second. A good rule of thumb is that each piece of content renders in around 1 millisecond.

Hugo is designed to work well for any kind of website including blogs, tumbles, and docs.

Supported Architectures

Currently, we provide pre-built Hugo binaries for Windows, Linux, FreeBSD, NetBSD, DragonFly BSD, Open BSD, macOS (Darwin), and Android for x64, i386 and ARM architectures.

Hugo may also be compiled from source wherever the Go compiler tool chain can run, e.g. for other operating systems including Plan 9 and Solaris.

Complete documentation is available at Hugo Documentation.

Choose How to Install

If you want to use Hugo as your site generator, simply install the Hugo binaries. The Hugo binaries have no external dependencies.

To contribute to the Hugo source code or documentation, you should fork the Hugo GitHub project and clone it to your local machine.

Finally, you can install the Hugo source code with go, build the binaries yourself, and run Hugo that way. Building the binaries is an easy task for an experienced go getter.

Install Hugo as Your Site Generator (Binary Install)

Use the installation instructions in the Hugo documentation.

Build and Install the Binaries from Source (Advanced Install)

Prerequisite Tools

Fetch from GitHub

Since Hugo 0.48, Hugo uses the Go Modules support built into Go 1.11 to build. The easiest is to clone Hugo in a directory outside of GOPATH, as in the following example:

mkdir $HOME/src
cd $HOME/src
git clone https://github.com/gohugoio/hugo.git
cd hugo
go install

If you are a Windows user, substitute the $HOME environment variable above with %USERPROFILE%.

The Hugo Documentation

The Hugo documentation now lives in its own repository, see https://github.com/gohugoio/hugoDocs. But we do keep a version of that documentation as a git subtree in this repository. To build the sub folder /docs as a Hugo site, you need to clone this repo:

git clone git@github.com:gohugoio/hugo.git

Contributing to Hugo

For a complete guide to contributing to Hugo, see the Contribution Guide.

We welcome contributions to Hugo of any kind including documentation, themes, organization, tutorials, blog posts, bug reports, issues, feature requests, feature implementations, pull requests, answering questions on the forum, helping to manage issues, etc.

The Hugo community and maintainers are very active and helpful, and the project benefits greatly from this activity.

Asking Support Questions

We have an active discussion forum where users and developers can ask questions. Please don't use the GitHub issue tracker to ask questions.

Reporting Issues

If you believe you have found a defect in Hugo or its documentation, use the GitHub issue tracker to report the problem to the Hugo maintainers. If you're not sure if it's a bug or not, start by asking in the discussion forum. When reporting the issue, please provide the version of Hugo in use (hugo version).

Submitting Patches

The Hugo project welcomes all contributors and contributions regardless of skill or experience level. If you are interested in helping with the project, we will help you with your contribution. Hugo is a very active project with many contributions happening daily.

We want to create the best possible product for our users and the best contribution experience for our developers, we have a set of guidelines which ensure that all contributions are acceptable. The guidelines are not intended as a filter or barrier to participation. If you are unfamiliar with the contribution process, the Hugo team will help you and teach you how to bring your contribution in accordance with the guidelines.

For a complete guide to contributing code to Hugo, see the Contribution Guide.

Analytics

Dependencies

Hugo stands on the shoulder of many great open source libraries, in lexical order:

Dependency License
github.com/BurntSushi/locker The Unlicense
github.com/BurntSushi/toml MIT License
github.com/PuerkitoBio/purell BSD 3-Clause "New" or "Revised" License
github.com/PuerkitoBio/urlesc BSD 3-Clause "New" or "Revised" License
github.com/alecthomas/chroma MIT License
github.com/bep/debounce MIT License
github.com/bep/gitmap MIT License
github.com/bep/go-tocss MIT License
github.com/niklasfasching/go-org MIT License
github.com/cpuguy83/go-md2man MIT License
github.com/danwakefield/fnmatch BSD 2-Clause "Simplified" License
github.com/disintegration/imaging MIT License
github.com/dlclark/regexp2 MIT License
github.com/eknkc/amber MIT License
github.com/fsnotify/fsnotify BSD 3-Clause "New" or "Revised" License
github.com/gobwas/glob MIT License
github.com/gorilla/websocket BSD 2-Clause "Simplified" License
github.com/hashicorp/go-immutable-radix Mozilla Public License 2.0
github.com/hashicorp/golang-lru Mozilla Public License 2.0
github.com/hashicorp/hcl Mozilla Public License 2.0
github.com/jdkato/prose MIT License
github.com/kyokomi/emoji MIT License
github.com/magiconair/properties BSD 2-Clause "Simplified" License
github.com/markbates/inflect MIT License
github.com/mattn/go-isatty MIT License
github.com/mattn/go-runewidth MIT License
github.com/miekg/mmark Simplified BSD License
github.com/mitchellh/hashstructure MIT License
github.com/mitchellh/mapstructure MIT License
github.com/muesli/smartcrop MIT License
github.com/nicksnyder/go-i18n MIT License
github.com/olekukonko/tablewriter MIT License
github.com/pelletier/go-toml MIT License
github.com/pkg/errors BSD 2-Clause "Simplified" License
github.com/russross/blackfriday Simplified BSD License
github.com/shurcooL/sanitized_anchor_name MIT License
github.com/spf13/afero Apache License 2.0
github.com/spf13/cast MIT License
github.com/spf13/cobra Apache License 2.0
github.com/spf13/fsync MIT License
github.com/spf13/jwalterweatherman MIT License
github.com/spf13/nitro Apache License 2.0
github.com/spf13/pflag BSD 3-Clause "New" or "Revised" License
github.com/spf13/viper MIT License
github.com/tdewolff/minify MIT License
github.com/tdewolff/parse MIT License
github.com/wellington/go-libsass Apache License 2.0
github.com/yosssi/ace MIT License
golang.org/x/image BSD 3-Clause "New" or "Revised" License
golang.org/x/net BSD 3-Clause "New" or "Revised" License
golang.org/x/sync BSD 3-Clause "New" or "Revised" License
golang.org/x/sys BSD 3-Clause "New" or "Revised" License
golang.org/x/text BSD 3-Clause "New" or "Revised" License
gopkg.in/yaml.v2 Apache License 2.0