Release update.
Please read the upgrade post from 1.2 > 1.3 before you start - Click here

New

• API Based Device Discovery (a.k.a. Retriever)
  • We build a new Container called the Retriever. You can get this by replacing the original compose file with the latest one from our Gitlab.
  • API vault, to support the Cloud / API controllers
  • Support for the following vendors:
    • Unifi
    • Meraki
    • Aruba Central
    • Next Central
  • It's still in beta so expect more updates soon
• Low Bandwidth Mode
  • You can enable a Service Worker to cache all local content in the browser for when the user has limited bandwidth or a slow connection.  PORTAL_ENABLE_SERVICE_WORKER: true
• Restricted Commands:
  • Disable the use or certain SSH / Telnet commands in Templates & Plannings.
• VRF automatically attached to Data
  • When you run a Chained Command on a VRF, it was not always returning the VRF in the Data Object. For example show ip vrf test will return a list of IPs but it will not set the VRF behind every IP. We do this now automatically for you.
• Raw JSON Inventory Object:
  • When we find a Device we parse the object toward the inventory, the object is now also stored per device and can be seen in the UI and grabbed via the API.
• New Report Exporter:
  • The Collected Data reporter can now export very large data sets and will automatically split it in files of 50k records.
• Hostname parsing:
  • In the past this happened in the back-end, now it happens by default in a transform rule called: Hostname strip FQDN
    This gives the user more controll over the hostname.
• Device Parent
  • The first step towards supporting Stacks the right way. When devices have a parent, for example APs discovered on a WLC it will now be shown to which device they belong.
• New improved Driver Detection
  • All the supported drivers can be easily detected now and also the detection between IOS & XE is improved
• SNMP Data Discovery improved for
  • Cisco WLC
  • Aruba Controllers (AP detection)
  • Gigamon
  • Juniper
  • Checkpoint
• Live Tester for the Data Collector Transform Rules
  • When building a rule you can now search for a device and planning to test it against real data.
• Drivers:
  • ribbon_neptune
  • harmonic_cableos
  • Aruba Central
  • Next Central
  • Meraki Cloud
  • Unifi Cloud & On-prem
  • smartoptics_dwdm
  • hioso_olt_telnet
  • huawei_ont
  • aviat_wtm
  • iij_seilos
  • avara_aos
  • lancom_lcossx5
  • fujitsu_sir
  • westermo_os
  • cisco_s500
  • furukawa_fitelnet

  Bug Fixes & Improvements

  • License session got lost sometimes and therefor the LDAP configuration was disabled
  • Forward Headers parsing improvement
  • Site Sync towards Netbox & Nautobot is improved
  • The callback was not syncing all interface details towards Netbox & Nautobot
  • SNMP strings with quotes weren't escaped in the browser
  • regex_replace improvement for the Transform Rules
  • No-string-checking ssh config for the scraper container
  • New indexes in the warehouse to improve the data retrieval
  • Scraper Debugging by default not showing any password anymore, enable SCRAPER_DEBUG_EXTRA to debug sensitive information
  • Table report for collected data was not working when you selected ALL data.
  • Mariadb-client is used instead of mysql-client for backup & restore
  • Netpicker Syncer will now sync the vault to all Agents
  • Netpicker Syncer will set the agent_id per Device automatically
  • Jinja2 rules now accept comments
  • Creating templates via the API was not setting the UID
  • When setting or changing a Device Tag the Changed Date was not updated
  • Device Finder has an Advanced Option in the gui to disable the Pre-check for discovering active IPs with ICMP or a Port Scan
  • Import & Export for Tags
  • Set Rule order on creation (with the API)

Minor release update.
Please read the upgrade post from 1.2 > 1.3 before you start - Click here

New

• Device Finder Report
  • Export from the Device Finder page easily a report with the results
• SNMP Tester debug option:
  • Option to return more values which can be used to improve the discovery
• Configurable Callback logic:
  • The priority for when a Device should be added or updated is now configurable
• New Report Exporter:
  • The table/grid exporter gives you now 2 options. Export what you currently see or Export all data.
• New API calls:
  • Get all batches for Scanner & Scraper
  • Task Scheduler API calls
  • Alert & Transform Rules
• Drivers:
  • Cisco ISE
  • Cisco IOS WLC
    • Support for modern WLC's running on Cisco IOS

  Improvements

  • Config Diff would sometimes not load the VS Code editor with the diffs
  • Improved support for Legacy SSH kex
  • Switching between History & Unique data would not always refresh the table
  • Creating a new planning will now automatically set unique keys if non were set
  • Automatic Device Disable & Remove will verify first if the Scanner is actually running and alive. This way during a crash it won't accidentally disable your devices after the configured period.
  • Memory usage inside the Scanner container
  • SNMPv3 supports now PrivType & AuthPrive none
  • Devices discovered via a controller (e.g. APs from a WLC) have now Transform Rule support
  • Removed vaults are now also updating the Device Profile with prefered vaults
  • Planning import will now also update the scheduler status (enable / disable)
  • Device & Site import data blob was not handled well in the Audit Log page
  • Import / Export rule was ignoring the defined Comment

Minor release update.
Please read the upgrade post from 1.2 > 1.3 before you start - Click here

New

• Netpicker Vault syncer: Auto create & update vaults in Netpicker
• SNMP Debug option: Option to return all SNMP variables for debugging
• Device Finder play button: Run every device finder record manully
• New attributes for Netbox & Nautobox plugin:
  • VRF support for IPAM
  • VRF support for Prefixes
  • Speed, Duplex & IP Addresses for interfaces
• Drivers:
  • Calix AXE

Small Bug fix

• Netpicker duplicate devices: Some devices were added twice because of changing IPs & FQDN. Those will be upserted now.
• Auto Disabled & Remove devices will first verify if the Scanner is not offline.

Minor release update.
Please read the upgrade post from 1.2 > 1.3 before you start - Click here

New

• Drivers:
  • APC
  • Calix AXOS
  • OpenGear

Small Bug fix

• Single Device Collector call via the API will now also use the Share Session option.

Major release update.
Please read the upgrade post from 1.2 > 1.3 before you start - Click here

New

• Device Finder Type, We can now set a type when the Device Finder runs. Current Types are Target & Current Inventory. This was we can easily have the finder only scan over the existing devices.
• Global Search, When you search in the menu it will search over the Inventory but also provides a Global Search that will search over all Data. It's currently in BETA and not using the warehouse data yet.
• Audit Logs, In the main menu is now a new item called Logs. This contains all the platform logs including a new log called Audit Logs where we monitor all the system changes.
• Portal X Forward support, When your server is behind multiple proxy servers we can now forward and understand those headers.
• Admin password, now configurable in the compose file
• Version Update Notification, better UX for when a new version is available.
• API Filter, GET /scanner/{id}  and GET /scraper/{id} now have the option to provide a filter on the variables you would like to have returned.

Issues & Bug fixes

• Palo Alto banner issue.
• Air Gapped bug, some license users got a message that their server needed a license.
• Collected Data search field would dissapear sometimes when new columns where added or removed.
• Alert Rule callback bug fixes and improvements.
• API batch_id was sometimes returned as a integer and sometimes as a string. It's now always a integer
• Portal Image gave a JIT warning
• Device Finder was not always taking the Device Profile into account.
• API documentation is updated

New

• Fast Queue, There is a seperate queue which will handle UI requests for SNMP testing & Template testing. This way the back-end can be busy collecting data while you can still performs tests.
• Export device + data, you can now download the full device inventory to an Excel, Json or CSV.

• ARM support, Images are now compatible with ARM devices.
• New Device Finder API calls, you can now configure the Device Finder  via api.
• New Planning API calls, You can now export & import a planning via the api.
• Incomplete logs clean-up, Incomplete logs clear themself when new devices are discovered & detected.

Issues & Bug fixes

• Netbox API tester turned off the plugin for some systems
• Cisco WLC discovery can now handle large outputs
• Corrupt Transform rules are ignored
• MongoDB logging is reduced, please download the latest docker-compose.yml file
• Nokia_ISAM driver is improved
• gRPC reconnect is improved
• Replacing device with an Identical hostname but new hardware fix
• Session are now shared, so when using pre-commands to go into vdom, please start with an end to exit the existing mode.

Major release update.
Please read the upgrade post from 1.2 > 1.3 before you start - Click here

New

• Slurp'it MCP, Have you favorite LLM connect and talk to your network data. You can ask it questions, make changes and reports.
• Netpicker Syncer, Sync your devices automatically from Slurp'it to Netpicker including Tags, Vaults and Site information.
• Cisco WLC ap Discovery, APs are now discovered automatically via the Device Finder directly on WLCs.
• Smart FQDN Discovery: When a device has multiple IPs with FQDNs we can now discovery the MGMT fqdn and ignore the others.
• New Database Containers: Database images are now seperated, therefor the docker-compose.yml needs to be updated.
• SNMP Improvements: support snmpv1 and snmpv3 keys < 8
• Normalize ASN data: Set on the planning field the tag for normalize ASN and all the BGP numbers will be normalized to integers.
• Interface Status normalization: Same as for the ASN data there is also for Interface Status a column type now in the Plannings.
• Device Finder GUI changes: The start button has now a dropdown with start finder or start crawler. When you have overviews with large numbers of IPs it loads faster now.
• New API calls: Start finder with vault, CRUD for Tags on devices
• New Table Grid: Table grid where you can read all the data is re-build from scratch. Lot stayed the same but we have 2 new features included with a Static Header and Static Footer. You will see this appear when you scroll down or up a table.
• Config Diff filter: When you compare a config in the Device View it will now give you the option to filter on certains fields you want to exclude from the diff.

Issues & Bug fixes

• Performance update on Logging pages
• System API calls are filtered from API logs
• Incomplete logs show better results now
• Log pages show the worker tags for Enterprise setups
• Dockers logs showed sometimes duplicate logs

Large update with a ton of features and improvements

Features

• Vault groups, you can now specify multiple credentials for a single device in a vault group. The one that works will be remembered for next time to improve performance and speed.
• New drivers

  asterfusion_asternos
  bintec_boss
  cisco_ap
  hillstone_stoneos
  vertiv_mph
  nokia_isam

• Worker tags, for horizontal scaling & security domains it's now possible to set tags. This way you can spin up multiple Scanners & Scrapers, each listening to its own tag — similar to Git Runners.
• Service Manager: New application to manage multiple Slurp'it servers from a single interface.
• Auto-create sites: Slurp'it Site Rules now have the option to automatically create a new site.

Improvements

• Pagination will now be disabled before and after enable mode. Some devices did not allow pagination to be disabled in enable mode.
• Improved Cisco ACI support.
• Send serial information to plugins (NetBox / Nautobot).
• Blacklisted device status is now included in the Devices API.
• Added new API endpoints for Device Profiles.
• Variable to disable Scanner DNS lookup (SCANNER_DNS_LOOKUP_ENABLED).
• Variable to disable Scraper DNS lookup (SCRAPER_DNS_LOOKUP_ENABLED).
• Variable to enable DNS binding (PORTAL_BIND_DNS).
• Variable to enable Air-Gapped mode (PORTAL_AIR_GAPPED).
• Catch incorrect Enable password in logs when debugging is enabled.
• When a planning is changed during a scheduled job, the data handling for that change is improved.
• Interfaces are now always normalized when the data type is selected.
• Last Seen is now a static column in the device table.
• gRPC message size is now unlimited (previously 500MB).
• gRPC port is now configurable for workers (Scanner & Scraper).
• New variable for the Scraper to set a timeout for command execution (SCRAPER_COMMAND_TIMEOUT).
• Site Maps are disabled by default and must be enabled for privacy reasons. We use the OpenStreetMap API.

Issues & Bug fixes

• Portal queue was not always removing old data.
• Incomplete logs were sometimes not filled.
• LDAP improvements for LDAPS & special characters in names.
• Disabled some plugin workers on initial installation.
• Portal logging is now visible in Docker logs.

This release has a couple small bug fixes and improvements.

Improvements

• When a device is added by the Device Finder, the Site & Tag rules will be applied automatically.
• New Transform rule to better detect Device Serial Numbers from collected data
• Backup works now on self hosted MongoDB setups.
• Netbox & Nautobot Device syncer now also syncs Serials, Uptime & OS version

Issues & Bug fixes

• Pre-commands were not being saved.
• Snapshot API was not returning all the results
• Gui drawers (pop-ups that come from the side), sometimes poped up when you opened a Modal.

This release is all about Speed, Performance and managing very large networks.
For the last couple weeks we have been tuning and improving the Back-end so that collecting data is now more then 2 times faster as before.

New features

• Device Tags
  • Tag a Device or create a Tag rule to automatically Tag all your devices. Those tags can now be applied in a Planning so that you can filter our on which device a certain command should be executed.

In this example we Tagged a list of devices where we want to collect the routing table from. Only the devices with the Tag routing_table will be used in this planning. This way you can exclude large core routers or a group of small CPE's.

• Device Profiler
  • Profiling is build to optimize the communication toward a device. It's auto learning how fast the device normally responses, which vault is prefers and if a device is not available multiple times it will blacklist but also un-blacklist the device to avoid delay on the total collection batch.
  • Automatically adjust timeouts if needed
  • Remember prefered Vault (incase multiple configured)
  • Automatically blacklist a device when it's enabled but we can't login
• Improved Multi Processing
  • The way Slurp'it is using and sharing the CPU power of a server got a major upgrade. As an example, we can now collect 600.000+ records on 12.000 devices in 17 minutes with only an 8 core processor.
• Interface normalization
  • Created a new method to normalize interface. e.g. Lo becomes Loopback & BE becomes Bundle-Ethernet.
• UI update
  • Table filter icons take less space
  • Device view has direct tabs now to the Vault & Device Finder
  • Site view has features divided over tabs now
  • Horizontal table scroll is now always accessable, no need to scroll to the bottom
  • Fixed columns for smaller screen (Action buttons & couple others)
• Alert Rule tester
  • When building an Alert rule you can now also test it directly in the view
• DB size per planning
  • When you click in the Dashboard on the Database size label, it will open a pop-up where you can see in detail what planning is taking which amount of space.
• Device Finder ports
  • It's possible to have the Finder & Crawler search for SNMP devices on a different port then the default 161.
• Netbox & Nautobot Prefix sync
  • You can now define between which subnet size the prefixes need to be synced toward netbox or nautbot.
• New API calls
  • Create, Read, Update & Delete calls for Tags
  • When a new device is added by the finder or sync api call, it will first verify the device based on serial and then based on hostname. This way an existing device can change it's hostname now.
  • /devices/search,  get a list of filtered devices.

Issues & Bug fixes

• Some Cisco devices were stuck on a SNMP limbo, it could take up to 30 minutes before the SNMP OID was walked.
• Logging pages will now load every individual page per tab, before it was loading all tables which could make the Logging pages of both the Scanner & Scraper very slow.
• Single Device view was showing Plannings which it had no relation to.
• Containers are updated to the latest version of Linux & Python to patch a couple High CVE's.

• Device Finder port tester
  • When a device is being scanned on ports it will automatically detect if the SSH or Telnet driver is required. This will only work when SCANNER_TCP_PORTS is used. See https://slurpit.io/knowledge-base/fine-tune-the-device-finder/ 
  • When SSH is tested on a different port than 22, this port will be assigned to the device.
• Template tester now supports Telnet
• Calculate amount of days between last seen & First seen
  • We now calculate the amount of days a record stayed unique. This way you can easily get alle interfaces which are for example down for 30+ days.

• MongoDB self hosting got better support for variables in the connection string.
  https://slurpit.io/knowledge-base/self-host-the-databases/ 
• MariaDB self hosting has now SSL support.
  https://slurpit.io/knowledge-base/self-host-the-databases/ 
• Shortcut Menu
  • We made a start on the Shortcut menu, for the moment it's only available for Netpicker. You can enable it by adding the following 2 variables in your compose override for the portal container:
    PORTAL_MENU_MODE: "shortcuts"

    PORTAL_NETPICKER_URL: "https://netpicker.io"
• NetPicker sync
  • Via Administrator -> Alert Rules -> Device Finder. You can now enable the Netpicker sync, this implementation can also be used for other systems where you want Slurp'it to send newly discovered devices to an alternative system. Duplicate the rule and have it point toward your API.

Issues & Bug fixes

• Improved LDAP support for Microsoft AD
• When renaming the hostname, also the hostname in the Warehouse will be updated. Which means you will no longer lose your collected data when a hostname is renamed.
• Normalize interfaces will now always return an Interface. If we can't normalize it it will return the original interface.
• The gRPC configuration is updated for the Helmcharts
• Changing a planning will no longer freeze the warehouse. The job is placed in a seperated CPU thread.
• The configured Timeouts are now applied on the Template & SNMP testers.
• Scraper Result logs was not showing any usefull information.
• Add telnet supported device via the API

New release with powerfull new features & improvements.

This release requires a couple changes in the Compose files.

1. Download and replace the docker-compose.yml file from our GIT:
   https://gitlab.com/slurpit.io/images/-/blob/main/docker-compose.yml
2. In your docker-compose.override.yml replace the following:
   1. Rename the following environment variables:
      SCANNER_WAREHOUSE_URL -> SCANNER_WAREHOUSE_HOSTNAME
      SCRAPER_WAREHOUSE_URL -> SCRAPER_WAREHOUSE_HOSTNAME

   2. Remove the starting http:// for the new Scanner & Scraper environment variables
      old
      SCANNER_WAREHOUSE_URL: http://slurpit-warehouse
      SCRAPER_WAREHOUSE_URL: http://slurpit-warehouse

      new
      SCANNER_WAREHOUSE_HOSTNAME: slurpit-warehouse
      SCRAPER_WAREHOUSE_HOSTNAME: slurpit-warehouse

• gRPC implementation
  • The communication between the Scanner, Scraper & Warehouse are now using a gRPC stream. This removes the limitation of the amount of sessions that could be handled between the workers.
• New menu style
• Function calling in the Jinja2 Transform rules
  • You can use Collected Data to manipulate the Device Finder when a new Device is discovered. For example if you don't like the Device Type we set based on the OID but you prefer to use the one from a planning, you can now override the data.

• SSH key support for the vault
• API, Threads & Async performance is improved inside the application.
• Collected Data has now next to Historic, Unique also the option Last Run.
  • Last Run shows you the data from the last Batch ID
• The Device Reachable check goes now via the Warehouse and not via the Portal anymore.
• Extra SNMP data is now stored for the device object
  • Uptime
  • OID number
  • Location
  • Contact
  • Serial number
  • Version

• Alert & Transform rules are now automatically synced with the warehouse when the application starts and not only when a rule is saved.
• Chained Templates
  • Inside a planning when you select a template it's not possible to call another template to generate Variable Commands. For example you first pars all the VRFs from the Show vrf template and you use those VRFs to auto generate the show ip arp vrf {{VRF NAME}} command.

• Bug fixed for Hostname sorting in the inventory table.
• Amount of records in the inventory table extended with 500, 1000 & 2000
• Deleting a device from the inventory is now instant. Before there was a little delay since it was waiting for the warehouse to remove the related Collected Data.
• New SSH drivers
  • Nvidia Cumulus
  • Aruba Silverpeak
  • Telco Systems
• Reduced the amount of DNS lookups between the Scanner. Scraper & Warehouse.
• LDAP improvements. This is a feature which requires a professional license.
• Bug fix: Planning search was showing the wrong Date notation (thanks Jens for reaching out on Discord)
• Collect or Delete specific Collected Data for a device

• You can now trigger a full Data Collect job for a single or group of  devices via the API. This is a feature which requires a professional license.
• Normalize Interfaces (beta). You can set in a planning per column a new meta data attribute called Interface. When set and the collected data contains an Interface, this abbreviation will automatically be normalised.
• Couple new Platform API calls to have you monitor the platform (see Swagger).
  • Version
  • Connectivity calls
  • DB size
  • License status

This release contains small improvements, bug fixes and a couple new vendors.

• Edgecore Sonic SSH driver added
• Cisco Nexos Telnet driver added
• Oneaccess Ekinops SSH driver added
• Ciena Saos10 SSH driver added
• Enable password support, in the vault you can now set an Enable password as well. This will only be used if the device asks for it.
• Device Finder incomplete logs are now only showing unique results
• IP -> FQDN lookup also works on PTR records now
• Permission fix for applications backups
• We made a start on including End of Life data
• Support simultaneous requests in the portal to improve UX experience while waiting for back-end data.
• Device Finder Hostname with a dot fix. Hostnames with a DOT are now correctly added to the system
• We made a start on including SNMP data to the discovered devices.
• Device Type database updated
• MIB database updated
• Table filter bug solved, the search fields would dissapear when you would change the table layout
• Possible now to set the Disabled status to 1 for new Discovered Devices in Transform rules.

For new installations, the default username is changed from [email protected] to just admin.

This release contains Security Improvements, New Features and a couple Bug fixes.

• Option to disable init for K8S implementations
• Devices menu is renamed to Inventory
• Option to have the Device Finder read your Netbox & Netbox prefixes for scanning networks.
• Concat Collected Data fields: Templates variables can be added to the same field. When empty it's ignored else it's seperated by a comma.
• Automatic MIB & Device Type online syncer: Request a device change or supply a mib and we can now update it on the fly.
• SSH legacy support, we can now also connect to devices with an older SSH version.
• Bulk edit for devices
• Copy workaround for HTTP connections. Browsers disable the option to copy text by clicking on a button when the connection is not using HTTPS. We made a workaround for this.
• Huawei_vrp template fix, the vrp part was not stripped correctly when importing templates.
• Podman support for Podman 5.x
• LDAP support for enterprise licensed customers.
• Remember tabs, when you fresh the page the session will remember the sub tabs you visited
• Portal Warehouse token, when you do the multi server setup it's now possible to give every container his own security key for authentication between the containers.
• Auto select first planning: In the device view when you navigate to Collected Data it will now auto select the first planning.
• Site rules is now also available in Administrator -> Rules -> Site rules
• Linux corelight SSH driver added
• Nokia Infinera SSH driver added
• Nokia Infinera Telnet driver added
• Ciena Waveserver SSH driver added
• Cisco ACI SSH driver added
• Fiberstore SSH driver added

This release contains Security Improvements, New Features and a couple Bug fixes.

• Data export bug is solved
• Site rules endpoints are added to the API
• Dynamic Portal_base_url, DNS binding because optional by default since this release.
• Root user is removed from all Containers. The containers now run their own user which adds a new layer of security.
• SNMP groups, a common feature request was to create a possibility to have the finder use multiple SNMP credentials. Incase the first pair would fail then automatically the next in line will be tried. The Finder & Crawler work therefor now with SNMP groups, those groups can be configured via: Menu -> Administrator -> Vault -> SNMP
• Telnet support, next to SSH we support also telnet now.
• Darkmode is improved in the Table filter
• Site rules now also exist under: menu -> Administrator -> Rules -> Site rules
• Sensitive fields are now by default protected with Astrics
• Encryption keys between the containers for communication.
• Escaped the collected data tables to preview collected data containing html tags.
• Warehouse portal environment is changed.
  WAREHOUSE_CALLBACK_SCANNER_URL,
  WAREHOUSE_CALLBACK_SCRAPER_URL

  are now
  WAREHOUSE_PORTAL_URL

  following variables are deprecated
  WAREHOUSE_CALLBACK_SCANNER_TOKEN
  WAREHOUSE_CALLBACK_SCRAPER_TOKEN

• Alert rules, you can now create a webhook based on certain logic to send out an e-mail or even a slack message when something is collected or discovered. Menu -> Administator -> Rules -> Alert rules
• Portal batch-size is varialble. Some users have a proxy in-front of their Netbox or Nautobot system. This lead sometimes to a Packet too Big message because our Payload toward the plugin could be a couple MB. It's not possible to lower the batch size for this reason. Variable to set in the Portal environment is:
  PORTAL_PLUGIN_BATCH_SIZE, default is 10000

Minor fixes

• Better HPE Comware support
• Fix where saving pre-commands did not work
• New pop-up menu
• Device Finder update, You can now tweak how it will find devices on your network, for example first a port scan before it does an SNMP request. See the manual for more information on chapter 3.3.9 https://gitlab.com/slurpit.io/images/-/blob/main/Installation%20Manual.pdf?ref_type=heads
• Communication tokens between the containers, usefull for when you scale the application over multiple servers

Minor fixes

• Better HPE Comware support
• Fix where saving the rules no longer worked
• When adding, updating or syncing a device via the API it will automatically trigger the site rules now
• Slurp'it Template builder is added when building or changing a template. Also visible via: https://textfsm.slurpit.io

This release contains mainly feature requests and lessons learned improvements

• Bulk delete for devices
• Device Crawler can now craw Networks as well (e.g. 192.168.1.0/24)
  • Connect it to your routing table planning for improved crawling
• Device Finder improvement for the special AES-256-C implementation of Cisco
  • For more information: https://community.cisco.com/t5/network-management/snmpv3-with-aes256-not-working-in-cisco-routers/td-p/2864795
• Task Scheduler queue is now visible via Administrator -> Task Scheduler -> Queue
• When we purge a device we also delete the data in the Warehouse now
• Table views can remember the current state now when you hide or show columns
• Couple gui improvements and css fixes
  • Some menu tabs didn't show a orange active line
  • Parts where you can enlarge the view like Template tester now has a drag and drop icon
• Improved the device recognition part for ExtremeXOS
• Site page has now by default a map with an option to show the map in fullscreen
  • You can turn this off as well in Settings -> General

• Sync button in the plugin page got a speed performance.
• Sync Site data toward the plugin
• Slurp'it images are now deployed on Red Hat Quay as well: https://quay.io/organization/slurpit
• Data Tabs data is no longer pushed toward your SSOT
  • In some situations the amount of data sent toward your SSOT was so much that it would meld down the SSOT system. Therefor Data Tabs functionality only works with the pull mechanism from now on.

This release contains a couple small improvements after the 1.1.3 release from last week.

• Added Site phone number when creating a new site
• Added State & County to sites
• When adding a device you can now test the login connectivity based on the device based vault as well
• Template tester has now a copy button for when you want the copy the output
• Small gui fixes
• Site Map improvement for USA based locations
• Improved data queing toward NetBox & Nautobot

This release is a minor update to Slurp'it 1.1.x, the following is changed or added in this release:

• Template pre-commands
  • It's possible to have a selection of commands being executed before we apply the template. Fortinet requires this in case you want to go into a specific VDOM mode. You can configure your own Pre-commands and then select it per template (menu: templates -> pre-commands).
• Advanced Table Filter
  for months we worked on our own Table filter, we will keep improving it but for the moment it's applied on all the tables with support for:
  • Data prediction
  • Logical search operations with AND, OR, BETWEEN and many more options.

• Backup and Restore
  • By default the Portal & Warehouse will make a backup every day and once every 32 weeks.
  • It's possible to trigger manual backups per container by calling /backup/backup.sh
  • It's possible to restore the container seperatly by calling /backup/restore.sh 20240101  (where the number will be the date of the backup you want to restore).
  • For more information about how to configure it have a look at the Installation Manual.pdf on Git.
• Rule testing is improved
  • You can now grab live data while creating a Transform rule
  • It's possible to extend the Live output by making the Drawer (html box that comes in from the right) smaller or wider with the mous. Like  how you would make your browser window smaller or wider.
  • When you save a rule and load it again it will keep the latest Example data you left in there.

• Vault changes
  • Vault passwords are no longer visible in the gui
  • We added a 3th vault option; a Vault per device

• Sites
  • Basic site information
  • Site rules to automatically assign devices to sites
  • Visual Map
  • Devices grouped per site
  • Test tool to see to which site your device would be mapped
  • Reset tool to automatically re-assign your devices to the right site
  • CSV Importer
  • API set to Create, Read, Update & Delete sites

• OID database updates
  • Next release we will make this customizable
• Option to define Custom database credentials
• Device Finder improvements
  • Crawler IPs that overlap with the finder will be ignored
  • Subnets that are excluded from SNMP are also excluded from the first ping check
  • SNMP credentials are now shown as Astrics in the table
• GUI improvements
  • Better support for low resolution screens
  • Possibility to drag and drop the Drawers to enlarge the view
• Planning slug
  • Unique normalized planning name is added for improved SDK support
• Queuing became a bit smarter
  • Before the trigger was time-based, but now when a job is finished it will auto trigger the next one
• List values in TextFSM templates
  • We had a couple senario's where we were expecting the return of an Ipam field or Interface to be a single value. But in some cases those were lists which lead to issues in the NetBox & Nautobot integration plugin. This is solved.

• Async implementation
  • Device Finder is now automatically splitting big subnets into smaller subnets. This increases the speed by searching over them using Async.
  • Data Collector is now using Async while fetching the latest data, so it's no longer needed to wait for a thread to finish.
• Our own Smart Filter is implemented for the Templates & Devices table, it contains:
  • Search prediction
  • Advanced filter to apply logic to your search

• Corrected multiple Device Types (thanks to the community)
• The SNMP tester is now using defined & enabled Tranforms Rules
• API pagination is alligned for all Get calls
• Remember checkbox in Login page
• Ruijie & Nokia templates are added
• Multiple small bugs and improvements

• Transform rules
  • It's now possible to manipulate incoming data from the Data Collector and Device Finder by building your own Jinja Template. This way you can build your own normalization and standardisation of the data we find in the Network.

• Plugin improvements
  • New Authorization types for your favorite SSOT
  • Nautobot added in the plugin selection
  • Netbox type has now the option to select which data models you would like to sync, current options are:
    • Devices
    • Data tabs
    • Interfaces
    • Ipam
    • Prefixes
• Queue improvement
  • It's now possible to see what is in the Device Finder and Data Collector queue by clicking on the name in the right top
  • Plugin has an improved queue when new data is found in the network. We will sync everything in batches of 50 records every minute to preserve server load.
  • Device Finder queue protection, when a queue is running and you click on schedule again it won't be added
  • Clear queue button for both Data Collector and Device Finder
• Clean up devices setting
  • In settings -> general you can now specify after how many days we should disable or remove the device if they are no longer spotted by the Device Finder.
• Removed version tag from the compose file
• Added password complexity setting for local account to be NIS compliant
• New API call for the Scraper to get all IPAM data incase you want to create your own IPAM plugin for tools like Infoblox
• All example CSVs are changed from the delimiter ; to ,
• Test worker connection button, when a worker is red (offline) you will see a refresh icon to test connectivity.
• Slurpit SDK for python projects (https://gitlab.com/slurpit.io/slurpit_sdk)

• Device search added in the top
• New device design
  • More details about your device
  • Option to leave some remarks about the device
  • Activity overview tab
  • Collected data tab of your device

• Swagger download option (to import it into your favorite API tester)
• CSV export is added (comma seperated)
• Hostnames discovered by the Device Finder are no longer saved as FQDN. Existing onces will be renamed by the Finder when the device is found.
• DNS failure was logged as Authentication time-out
• Device Finder (scanner) logs are improved
• Device Finder queue & progress is added in the dashboard
• Darkmode styling is improved
• Snapshot API has now the data stacked per Planning result & Template result. Data attribute is kept for compatibility reasons and will be removed in the next release.
• SSH port is configurable per device (see add / edit device)
• Unique data contains now also a First seen field
• Data history/retention configurable per planning
• Database optimalisation (only store unique records option),
  
• Rate limit device requests (login & commands), More info
• Login retry option on failure, More info
• Automatically keep the Mac Vendors up-to-date
• MongoDB credentials option for Self-hosted databases, More info

• Included a plugin worker for better NetBox cloud support
• Disabled SSL validation for self signed NetBox deployments
• Changed the way to test the NetBox communication to avoid CORS errors

This is our first production release after the MVP was launched. The following was added in this release:

• New image added called Warehouse, the Warehouse is being introduced to support better indexes on Large Databases
• New Architecture which is prepared for Multi service deployments for enterprise networks
• Support voor Aruba CX added
• Crawler support, next to the Device Finder we now also have a crawler which can be used to discover new devices based on colelcted Planning data.
• Plugin support: We can now integrate Slurp'it easier with your favorite existing Source of Truth application, in this release we included support for NetBox
• Test buttons when adding a new device
• OVA installation
• New API calls:
  • Platform testing, to verify connection between the plugin and Slurp'it
  • Device Snapshot: Create a logical device model based on the latest discovered planning data.
• Solved a bunch of bugs and issues:
  • Reduced the MongoDB logging to prevent the harddisk from being overloaded
  • Recuded the raw data we stored to get a smaller database.
  • Changed the way we communicate with devices to reduce latency issues
  • Improved the device finder for latency issues

Our first release was called the MVP, this was when we announced the product late 2023. In this version we released the following docker images:

• Docker images
  • Portal
  • Scraper
  • Scanner