If you notice content missing from your paper, check these reasons to troubleshoot why:
1. Does the post fall within the relevant timeframe?
For a paper publishing automatically, Paper.li searches the previous xx hours (24 if daily, every 12 hours for twice daily or 7 days for weekly) for unique links (URLS) shared by you and according to the other sources and key word searches you have chosen.
For a paper that is being published manually (i.e. draft mode), at the time you create your draft, Paper.li will search for content to populate your draft starting from the previous edition publish date/time. However, if the previous edition was published more than 7 days ago we collect maximum 7 days of content. If the previous edition was published less than 24 hours ago, we collect a minimum of 24 hours of content.
To check when a post was sent:
- For Twitter, check the timestamp link on the top right of the tweet to be sure the tweet falls within the correct timeframe.
- For RSS feeds, check the feed to verify that recent content has been published by adding your RSS to any RSS reader. (eg feedly.com)
- For youtube, dates are included in a posted video and will only be pulled if they fall within the correct timeframe.
Troubleshooting advice: Does the date/time of the missing post/tweet meet the criteria of your update period? If you are using an RSS feed, can the RSS feed be found in an RSS reader and if so, is there recent content?
Note also that if you the time of the tweet or post was too close to the publish time, the tweet or post is occasionally skipped over. If you believe that there is more recent content that the platform has missed, clicking (found in your Paper Settings Dashboard) will re-fetch the most recent content according to your sources.
2. Are you using the free plan?
Due to an increasing user base and our own capacity, we are not able to guarantee to free users that all content from their sources shared prior to publishing time will be fetched and included before an edition is published. We schedule the fetching of content at a "best effort" time, based on usage and our own capacity. Therefore, we are not able to guarantee for free users that all content shared prior to the publishing time will be pulled in and included on that day's edition. All content after the fetch date/time will be missing from the edition of the day (but they will be considered for inclusion the day after).
For users with Pro papers, we fetch content more frequently and as close to the publishing time as possible.
3. Is the post unique for your paper edition?
If your sources are sharing identical links, we will take the first link detected (chronological order).
4. If your paper is being updated automatically, was the article already included in your paper during the previous 14 days?
We have a rule in place which eliminates duplicate content from showing on auto-created editions in the past 14 days.
5. Is the URL shared (via RSS or Twitter) a "fetchable" URL?
There are several reasons why our platform may not be able to fetch the content on the URL and display it:
a. Check that the link is not broken. We filter as best we can and discard any broken links found.
b. Check that the link is not protected by a password. We are not able to present pages that are password protected.
c. If not an image or video, check that the URL shared is a link to an article. Our platform was designed to find and present articles, (images or videos). If there is no article shared, we can not pass the link onto a Paper.li paper.
d. Check that the link is not a root URL. Root URLs (home pages) will not be presented in a paper.li since home pages do not share articles. Example of a root URL: nytimes.com or amazon.com
e. Are you using linkis.com to shorten your URLs? We are not able to pull your content if you are using this link shortener because it uses an iframe for the content.
Troubleshooting advice: Use the bookmarklet to test the URL. The content found (if any) will be shown in the bookmarklet. If we are able to find an article, it will be shown, along with the default topic/category we've assigned.
6. If you are using automatic ranking, does the article have a minimum of 1500 characters?
If the article has less than 1500 characters and you are using auto ranking, the article will not be automatically pulled in. However, you may still use the bookmarklet to include the article.
7. Are the post(s) being excluded because of your filters?
If you are using a key word, check that those users are tweeting or posting on Twitter using the keyword on that list and the filters you have set.
8. Does the language of the article match the language criteria you set?
If you have chosen to find content in a specific language , we will discard any content found that does not match the language you have chosen. To check your language settings, go to your Paper Settings Dashboard, choose Content > Advanced Settings > Content language. Please note: Our system currently fetches content in English, French, Spanish, Italian, Portuguese, Japanese, German and Dutch.
9. Have you excluded some Paper Sections?
If you have excluded specific Paper sections, but our system categorizes the content found under one of those excluded Paper sections, the content will not be published. To check which Paper sections you have excluded, go to your Paper Settings Dashboard, click Content > Advanced Settings > Paper sections. Look for which Paper sections are not selected.
Troubleshooting advice: Use the bookmarklet to view how paper.li is categorizing the article.
The bookmarklet will show which Topic section we are assigning the article. If in the below example, the Covered Topic "Politics" had previously not been selected, the article below would not have appeared in the paper.
10. Was the article shared or posted very close to your paper's update time?
If the article was tweeted out very close to your paper's update time, it is possible that we might have skipped the post. For Pro papers, we increase the rate of discovery so that there's less chance of content being missed; we attempt to schedule a search of all Pro paper sources approximately 10 minutes before generating the paper.
11. Has the website or news sharer been blacklisted from your paper?
Go to your Paper Settings Dashboard, click Content > Advanced Settings, scroll down and select Blacklisted people or Blacklisted websites to check that the missing URL or news sharer or website has not been (accidentally or not) blacklisted from your paper in the past.
12. If the missing content is a video, has the "embed" setting been disabled?
Some videos from Youtube cannot be published through the Paper.li bookmarklet (such as http://www.youtube.com/watchfeature=player_detailpage&v=qq7fbMbJHsE).
If the owner of the video has requested that the video is not embeddable, then we will not be able to pull in the video to a paper.li.
To check if this is the case for the video you are trying to fetch, go to the the video in youtube.com, click "share" below the video, then "embed. If the video says "embedding disabled by request", then we will not be able to pull in the video.
13. Did the source (Twitter or website) have technical issues?
A random technical issue cannot be ruled out as a culprit when we fetch content. From time to time "something" happens that prevents us from fetching content. We have no control over outsides websites.
Check here for Twitter.
What should I do if none of these reasons apply to my case?
We are continually working on improving our web crawler to optimize how we pull content from the web. If none of the above situations apply to you, we can investigate. Tweet us at @paper_li with the following information:
(1) your paper URL,
(2) the edition date of the paper that had content missing, and
(3) For Twitter: the URL of the tweet(s)* that were not included
For an RSS feed: the name of the RSS feed and the URL of the article which was not included
(4 ) If using the bookmarklet: the URL which you are trying to add.
* To capture the URL of a tweet, click on the timestamp in the upper right hand corner of the tweet. Copy the URL of the missing tweet to send to us.